Nov 10 14:37:46 user nova-compute[75703]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75703) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 14:37:46 user nova-compute[75703]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75703) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 14:37:46 user nova-compute[75703]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75703) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 14:37:46 user nova-compute[75703]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 14:37:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:37:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:37:46 user nova-compute[75703]: INFO nova.virt.driver [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 14:37:46 user nova-compute[75703]: INFO nova.compute.provider_config [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Acquiring lock "singleton_lock" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Acquired lock "singleton_lock" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Releasing lock "singleton_lock" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Full set of CONF: {{(pid=75703) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ******************************************************************************** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Configuration options gathered from: {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ================================================================================ {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] allow_resize_to_same_host      = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] arq_binding_timeout            = 300 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] backdoor_port                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] backdoor_socket                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] block_device_allocate_retries  = 300 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] block_device_allocate_retries_interval = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cert                           = self.pem {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute_monitors               = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] config_dir                     = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] config_drive_format            = iso9660 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] config_source                  = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] console_host                   = user {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] control_exchange               = nova {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cpu_allocation_ratio           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] daemon                         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] debug                          = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] default_access_ip_network_name = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] default_availability_zone      = nova {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] default_ephemeral_format       = ext4 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] default_green_pool_size        = 1000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] default_schedule_zone          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] disk_allocation_ratio          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] enable_new_services            = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] enabled_ssl_apis               = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] flat_injected                  = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] force_config_drive             = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] force_raw_images               = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] graceful_shutdown_timeout      = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] heal_instance_info_cache_interval = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] host                           = user {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_build_timeout         = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_delete_interval       = 300 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_name_template         = instance-%08x {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_usage_audit           = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_usage_audit_period    = month {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] internal_service_availability_zone = internal {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] key                            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] live_migration_retry_count     = 30 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_config_append              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_dir                        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_file                       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_options                    = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_rotate_interval            = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_rotate_interval_type       = days {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] log_rotation_type              = none {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] long_rpc_timeout               = 1800 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] max_concurrent_builds          = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] max_concurrent_live_migrations = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] max_concurrent_snapshots       = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] max_local_block_devices        = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] max_logfile_count              = 30 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] max_logfile_size_mb            = 200 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] maximum_instance_delete_attempts = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metadata_listen                = 0.0.0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metadata_listen_port           = 8775 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metadata_workers               = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] migrate_max_retries            = -1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] mkisofs_cmd                    = genisoimage {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] my_ip                          = 10.0.0.210 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] network_allocate_retries       = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] osapi_compute_listen_port      = 8774 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] osapi_compute_unique_server_name_scope =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] osapi_compute_workers          = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] password_length                = 12 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] periodic_enable                = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] periodic_fuzzy_delay           = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] pointer_model                  = ps2mouse {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] preallocate_images             = none {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] publish_errors                 = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] pybasedir                      = /opt/stack/nova {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ram_allocation_ratio           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rate_limit_burst               = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rate_limit_except_level        = CRITICAL {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rate_limit_interval            = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reboot_timeout                 = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reclaim_instance_interval      = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] record                         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reimage_timeout_per_gb         = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] report_interval                = 120 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rescue_timeout                 = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reserved_host_cpus             = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reserved_host_disk_mb          = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reserved_host_memory_mb        = 512 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] reserved_huge_pages            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] resize_confirm_window          = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] resize_fs_using_block_device   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] resume_guests_state_on_host_boot = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rpc_response_timeout           = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] run_external_periodic_tasks    = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] running_deleted_instance_action = reap {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] running_deleted_instance_timeout = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler_instance_sync_interval = 120 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_down_time              = 720 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] servicegroup_driver            = db {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] shelved_offload_time           = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] shelved_poll_interval          = 3600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] shutdown_timeout               = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] source_is_ipv6                 = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ssl_only                       = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] state_path                     = /opt/stack/data/nova {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] sync_power_state_interval      = 600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] sync_power_state_pool_size     = 1000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] syslog_log_facility            = LOG_USER {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] tempdir                        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] timeout_nbd                    = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] transport_url                  = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] update_resources_interval      = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_cow_images                 = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_eventlog                   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_journal                    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_json                       = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_rootwrap_daemon            = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_stderr                     = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] use_syslog                     = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vcpu_pin_set                   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plugging_is_fatal          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plugging_timeout           = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] virt_mkfs                      = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] volume_usage_poll_interval     = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] watch_log_file                 = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] web                            = /usr/share/spice-html5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_concurrency.disable_process_locking = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.auth_strategy              = keystone {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.compute_link_prefix        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.dhcp_domain                = novalocal {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.enable_instance_password   = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.glance_link_prefix         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.instance_list_per_project_cells = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.list_records_by_skipping_down_cells = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.local_metadata_per_cell    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.max_limit                  = 1000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.metadata_cache_expiration  = 15 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.neutron_default_tenant_id  = default {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.use_forwarded_for          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.use_neutron_default_nets   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_dynamic_targets = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_jsonfile_path   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.backend_argument         = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.config_prefix            = cache.oslo {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.dead_timeout             = 60.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.debug_cache_backend      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.enable_retry_client      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.enable_socket_keepalive  = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.enabled                  = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.expiration_time          = 600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.hashclient_retry_attempts = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_dead_retry      = 300 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_password        =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_sasl_enabled    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.memcache_username        =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.proxies                  = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.retry_attempts           = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.retry_delay              = 0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.socket_keepalive_count   = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.socket_keepalive_idle    = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.socket_keepalive_interval = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.tls_allowed_ciphers      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.tls_cafile               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.tls_certfile             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.tls_enabled              = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cache.tls_keyfile              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.auth_section            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.auth_type               = password {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.cafile                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.certfile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.collect_timing          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.cross_az_attach         = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.debug                   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.endpoint_template       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.http_retries            = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.insecure                = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.keyfile                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.os_region_name          = RegionOne {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.split_loggers           = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cinder.timeout                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.cpu_dedicated_set      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.cpu_shared_set         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.image_type_exclude_list = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.resource_provider_association_refresh = 300 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.shutdown_retry_interval = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] conductor.workers              = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] console.allowed_origins        = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] console.ssl_ciphers            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] console.ssl_minimum_version    = default {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] consoleauth.token_ttl          = 600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.cafile                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.certfile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.collect_timing          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.connect_retries         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.connect_retry_delay     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.endpoint_override       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.insecure                = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.keyfile                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.max_version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.min_version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.region_name             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.service_name            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.service_type            = accelerator {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.split_loggers           = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.status_code_retries     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.timeout                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] cyborg.version                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.backend               = sqlalchemy {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.connection            = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.connection_debug      = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.connection_parameters =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.connection_recycle_time = 3600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.connection_trace      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.db_inc_retry_interval = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.db_max_retries        = 20 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.db_max_retry_interval = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.db_retry_interval     = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.max_overflow          = 50 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.max_pool_size         = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.max_retries           = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.mysql_wsrep_sync_wait = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.pool_timeout          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.retry_interval        = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.slave_connection      = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] database.sqlite_synchronous    = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.backend           = sqlalchemy {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.connection        = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.connection_debug  = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.connection_parameters =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.connection_recycle_time = 3600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.connection_trace  = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.db_inc_retry_interval = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.db_max_retries    = 20 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.db_max_retry_interval = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.db_retry_interval = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.max_overflow      = 50 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.max_pool_size     = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.max_retries       = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.pool_timeout      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.retry_interval    = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.slave_connection  = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] api_database.sqlite_synchronous = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] devices.enabled_mdev_types     = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ephemeral_storage_encryption.enabled = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.api_servers             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.cafile                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.certfile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.collect_timing          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.connect_retries         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.connect_retry_delay     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.debug                   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.default_trusted_certificate_ids = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.enable_certificate_validation = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.enable_rbd_download     = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.endpoint_override       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.insecure                = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.keyfile                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.max_version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.min_version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.num_retries             = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.rbd_ceph_conf           =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.rbd_connect_timeout     = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.rbd_pool                =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.rbd_user                =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.region_name             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.service_name            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.service_type            = image {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.split_loggers           = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.status_code_retries     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.timeout                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.verify_glance_signatures = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] glance.version                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] guestfs.debug                  = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.config_drive_cdrom      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.config_drive_inject_password = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.enable_remotefx         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.instances_path_share    =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.limit_cpu_features      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.use_multipath_io        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.vswitch_name            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] mks.enabled                    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] image_cache.manager_interval   = 2400 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] image_cache.precache_concurrency = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] image_cache.remove_unused_base_images = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] image_cache.subdirectory_name  = _base {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.api_max_retries         = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.api_retry_interval      = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.auth_section            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.auth_type               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.cafile                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.certfile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.collect_timing          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.conductor_group         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.connect_retries         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.connect_retry_delay     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.endpoint_override       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.insecure                = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.keyfile                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.max_version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.min_version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.peer_list               = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.region_name             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.serial_console_state_timeout = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.service_name            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.service_type            = baremetal {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.split_loggers           = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.status_code_retries     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.timeout                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ironic.version                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] key_manager.fixed_key          = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.barbican_api_version  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.barbican_endpoint     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.barbican_endpoint_type = public {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.barbican_region_name  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.cafile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.certfile              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.collect_timing        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.insecure              = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.keyfile               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.number_of_retries     = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.retry_delay           = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.send_service_user_token = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.split_loggers         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.timeout               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.verify_ssl            = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican.verify_ssl_path       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.auth_section = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.auth_type = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.cafile   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.certfile = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.collect_timing = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.insecure = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.keyfile  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.split_loggers = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] barbican_service_user.timeout  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.approle_role_id          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.approle_secret_id        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.cafile                   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.certfile                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.collect_timing           = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.insecure                 = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.keyfile                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.kv_mountpoint            = secret {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.kv_path                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.kv_version               = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.namespace                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.root_token_id            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.split_loggers            = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.ssl_ca_crt_file          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.timeout                  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.use_ssl                  = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.auth_section          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.auth_type             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.cafile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.certfile              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.collect_timing        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.connect_retries       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.connect_retry_delay   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.endpoint_override     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.insecure              = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.keyfile               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.max_version           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.min_version           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.region_name           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.service_name          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.service_type          = identity {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.split_loggers         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.status_code_retries   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.timeout               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] keystone.version               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.connection_uri         =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_mode               = custom {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: WARNING oslo_config.cfg [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_power_governor_high = performance {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_power_management   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.device_detach_attempts = 8 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.device_detach_timeout  = 20 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.disk_cachemodes        = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.disk_prefix            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.enabled_perf_events    = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.file_backed_memory     = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.gid_maps               = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.hw_disk_discard        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.hw_machine_type        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_rbd_pool        = rbd {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_type            = default {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.images_volume_group    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.inject_key             = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.inject_partition       = -2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.inject_password        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.iscsi_iface            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.iser_use_multipath     = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_downtime = 500 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_inbound_addr = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_scheme  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_timeout_action = abort {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_tunnelled = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: WARNING oslo_config.cfg [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 14:37:47 user nova-compute[75703]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 14:37:47 user nova-compute[75703]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 14:37:47 user nova-compute[75703]: and ``live_migration_inbound_addr`` respectively.
Nov 10 14:37:47 user nova-compute[75703]: ).  Its value may be silently ignored in the future.
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.live_migration_with_native_tls = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.max_queues             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.nfs_mount_options      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.num_pcie_ports         = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.pmem_namespaces        = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.quobyte_client_cfg     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rbd_secret_uuid        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rbd_user               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rescue_image_id        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rescue_kernel_id       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.rx_queue_size          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.smbfs_mount_options    =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.snapshot_compression   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.snapshot_image_format  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.sparse_logical_volumes = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.swtpm_enabled          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.swtpm_group            = tss {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.swtpm_user             = tss {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.sysinfo_serial         = unique {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.tb_cache_size          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.tx_queue_size          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.uid_maps               = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.use_virtio_for_bridges = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.virt_type              = kvm {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.volume_clear           = zero {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.volume_clear_size      = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.volume_use_multipath   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_cache_path   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.auth_section           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.auth_type              = password {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.cafile                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.certfile               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.collect_timing         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.connect_retries        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.connect_retry_delay    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.default_floating_pool  = public {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.endpoint_override      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.extension_sync_interval = 600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.http_retries           = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.insecure               = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.keyfile                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.max_version            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.min_version            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.ovs_bridge             = br-int {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.physnets               = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.region_name            = RegionOne {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.service_metadata_proxy = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.service_name           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.service_type           = network {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.split_loggers          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.status_code_retries    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.timeout                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] neutron.version                = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] notifications.bdms_in_notifications = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] notifications.default_level    = INFO {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] notifications.notification_format = unversioned {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] notifications.notify_on_state_change = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] pci.alias                      = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] pci.device_spec                = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] pci.report_in_placement        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.auth_section         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.auth_type            = password {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.cafile               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.certfile             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.collect_timing       = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.connect_retries      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.connect_retry_delay  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.default_domain_id    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.default_domain_name  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.domain_id            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.domain_name          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.endpoint_override    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.insecure             = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.keyfile              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.max_version          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.min_version          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.password             = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.project_domain_id    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.project_domain_name  = Default {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.project_id           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.project_name         = service {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.region_name          = RegionOne {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.service_name         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.service_type         = placement {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.split_loggers        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.status_code_retries  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.system_scope         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.timeout              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.trust_id             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.user_domain_id       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.user_domain_name     = Default {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.user_id              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.username             = placement {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] placement.version              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.cores                    = 20 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.count_usage_from_placement = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.injected_file_content_bytes = 10240 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.injected_file_path_length = 255 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.injected_files           = 5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.instances                = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.key_pairs                = 100 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.metadata_items           = 128 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.ram                      = 51200 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.recheck_quota            = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.server_group_members     = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] quota.server_groups            = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rdp.enabled                    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.image_metadata_prefilter = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.max_attempts         = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.max_placement_results = 1000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] scheduler.workers              = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.host_subset_size = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.isolated_hosts = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.isolated_images = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.pci_in_placement = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.track_instance_changes = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metrics.required               = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metrics.weight_multiplier      = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] metrics.weight_setting         = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] serial_console.enabled         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] serial_console.port_range      = 10000:20000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] serial_console.serialproxy_port = 6083 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.auth_section      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.auth_type         = password {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.cafile            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.certfile          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.collect_timing    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.insecure          = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.keyfile           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.send_service_user_token = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.split_loggers     = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] service_user.timeout           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.agent_enabled            = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.enabled                  = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.html5proxy_port          = 6082 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.image_compression        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.jpeg_compression         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.playback_compression     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.server_listen            = 127.0.0.1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.streaming_mode           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] spice.zlib_compression         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] upgrade_levels.baseapi         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] upgrade_levels.cert            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] upgrade_levels.compute         = auto {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] upgrade_levels.conductor       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] upgrade_levels.scheduler       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.cafile = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.certfile = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.insecure = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vendordata_dynamic_auth.timeout = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.api_retry_count         = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.ca_file                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.cache_prefix            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.cluster_name            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.connection_pool_size    = 10 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.console_delay_seconds   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.datastore_regex         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.host_ip                 = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.host_password           = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.host_port               = 443 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.host_username           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.insecure                = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.integration_bridge      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.maximum_objects         = 100 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.pbm_default_policy      = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.pbm_enabled             = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.pbm_wsdl_location       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.serial_port_proxy_uri   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.serial_port_service_uri = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.task_poll_interval      = 0.5 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.use_linked_clone        = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.vnc_keymap              = en-us {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.vnc_port                = 5900 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vmware.vnc_port_total          = 10000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.auth_schemes               = ['none'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.enabled                    = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.novncproxy_port            = 6080 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.vencrypt_ca_certs          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.vencrypt_client_cert       = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vnc.vencrypt_client_key        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.disable_rootwrap   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.enable_numa_live_migration = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.libvirt_disable_apic = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.client_socket_timeout     = 900 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.default_pool_size         = 1000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.keep_alive                = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.max_header_line           = 16384 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.ssl_ca_file               = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.ssl_cert_file             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.ssl_key_file              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.tcp_keepidle              = 600 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] zvm.ca_file                    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] zvm.cloud_connector_url        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] zvm.reachable_timeout          = 300 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.enforce_new_defaults = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.enforce_scope      = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.policy_default_rule = default {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.connection_string     = messaging:// {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.enabled               = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.es_doc_type           = notification {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.es_scroll_size        = 10000 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.es_scroll_time        = 2m {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.filter_error_trace    = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.hmac_keys             = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.sentinel_service_name = mymaster {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.socket_timeout        = 0.1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.trace_requests        = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler.trace_sqlalchemy      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler_jaeger.process_tags   = {} {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler_jaeger.service_name_prefix = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] profiler_otlp.service_name_prefix = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] remote_debug.host              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] remote_debug.port              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_notifications.retry = -1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.auth_section        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.auth_type           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.cafile              = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.certfile            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.collect_timing      = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.connect_retries     = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.connect_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.endpoint_id         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.endpoint_override   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.insecure            = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.keyfile             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.max_version         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.min_version         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.region_name         = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.service_name        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.service_type        = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.split_loggers       = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.status_code_retries = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.status_code_retry_delay = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.timeout             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.valid_interfaces    = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_limit.version             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_reports.file_event_handler = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] oslo_reports.log_dir           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_ovs_privileged.group  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] vif_plug_ovs_privileged.user   = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.isolate_vif         = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] os_brick.lock_path             = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] privsep_osbrick.capabilities   = [21] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] privsep_osbrick.group          = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] privsep_osbrick.helper_command = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] privsep_osbrick.user           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] nova_sys_admin.group           = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] nova_sys_admin.helper_command  = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] nova_sys_admin.user            = None {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG oslo_service.service [None req-ad147d19-e54d-4699-97fe-dab27a957482 None None] ******************************************************************************** {{(pid=75703) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 14:37:47 user nova-compute[75703]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Connecting to libvirt: qemu:///system {{(pid=75703) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb4c87aaf50> {{(pid=75703) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 14:37:47 user nova-compute[75703]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 14:37:47 user nova-compute[75703]: WARNING nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb4c87aaf50> {{(pid=75703) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Starting native event thread {{(pid=75703) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Starting green dispatch thread {{(pid=75703) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Starting connection event dispatch thread {{(pid=75703) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 14:37:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Connection event '1' reason 'None'
Nov 10 14:37:47 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 14:37:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.mount [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Initialising _HostMountState generation 0 {{(pid=75703) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 14:37:54 user nova-compute[75703]: INFO nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host capabilities <capabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <host>
Nov 10 14:37:54 user nova-compute[75703]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 14:37:54 user nova-compute[75703]:     <cpu>
Nov 10 14:37:54 user nova-compute[75703]:       <arch>x86_64</arch>
Nov 10 14:37:54 user nova-compute[75703]:       <model>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <microcode version='1070'/>
Nov 10 14:37:54 user nova-compute[75703]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='osxsave'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='invtsc'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='rsba'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 14:37:54 user nova-compute[75703]:       <pages unit='KiB' size='4'/>
Nov 10 14:37:54 user nova-compute[75703]:       <pages unit='KiB' size='2048'/>
Nov 10 14:37:54 user nova-compute[75703]:     </cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <power_management>
Nov 10 14:37:54 user nova-compute[75703]:       <suspend_mem/>
Nov 10 14:37:54 user nova-compute[75703]:       <suspend_disk/>
Nov 10 14:37:54 user nova-compute[75703]:       <suspend_hybrid/>
Nov 10 14:37:54 user nova-compute[75703]:     </power_management>
Nov 10 14:37:54 user nova-compute[75703]:     <iommu support='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <migration_features>
Nov 10 14:37:54 user nova-compute[75703]:       <live/>
Nov 10 14:37:54 user nova-compute[75703]:       <uri_transports>
Nov 10 14:37:54 user nova-compute[75703]:         <uri_transport>tcp</uri_transport>
Nov 10 14:37:54 user nova-compute[75703]:         <uri_transport>rdma</uri_transport>
Nov 10 14:37:54 user nova-compute[75703]:       </uri_transports>
Nov 10 14:37:54 user nova-compute[75703]:     </migration_features>
Nov 10 14:37:54 user nova-compute[75703]:     <topology>
Nov 10 14:37:54 user nova-compute[75703]:       <cells num='2'>
Nov 10 14:37:54 user nova-compute[75703]:         <cell id='0'>
Nov 10 14:37:54 user nova-compute[75703]:           <memory unit='KiB'>8140616</memory>
Nov 10 14:37:54 user nova-compute[75703]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 10 14:37:54 user nova-compute[75703]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 14:37:54 user nova-compute[75703]:           <distances>
Nov 10 14:37:54 user nova-compute[75703]:             <sibling id='0' value='10'/>
Nov 10 14:37:54 user nova-compute[75703]:             <sibling id='1' value='20'/>
Nov 10 14:37:54 user nova-compute[75703]:           </distances>
Nov 10 14:37:54 user nova-compute[75703]:           <cpus num='6'>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 14:37:54 user nova-compute[75703]:           </cpus>
Nov 10 14:37:54 user nova-compute[75703]:         </cell>
Nov 10 14:37:54 user nova-compute[75703]:         <cell id='1'>
Nov 10 14:37:54 user nova-compute[75703]:           <memory unit='KiB'>8255068</memory>
Nov 10 14:37:54 user nova-compute[75703]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 10 14:37:54 user nova-compute[75703]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 14:37:54 user nova-compute[75703]:           <distances>
Nov 10 14:37:54 user nova-compute[75703]:             <sibling id='0' value='20'/>
Nov 10 14:37:54 user nova-compute[75703]:             <sibling id='1' value='10'/>
Nov 10 14:37:54 user nova-compute[75703]:           </distances>
Nov 10 14:37:54 user nova-compute[75703]:           <cpus num='6'>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 14:37:54 user nova-compute[75703]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 14:37:54 user nova-compute[75703]:           </cpus>
Nov 10 14:37:54 user nova-compute[75703]:         </cell>
Nov 10 14:37:54 user nova-compute[75703]:       </cells>
Nov 10 14:37:54 user nova-compute[75703]:     </topology>
Nov 10 14:37:54 user nova-compute[75703]:     <cache>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 14:37:54 user nova-compute[75703]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 14:37:54 user nova-compute[75703]:     </cache>
Nov 10 14:37:54 user nova-compute[75703]:     <secmodel>
Nov 10 14:37:54 user nova-compute[75703]:       <model>apparmor</model>
Nov 10 14:37:54 user nova-compute[75703]:       <doi>0</doi>
Nov 10 14:37:54 user nova-compute[75703]:     </secmodel>
Nov 10 14:37:54 user nova-compute[75703]:     <secmodel>
Nov 10 14:37:54 user nova-compute[75703]:       <model>dac</model>
Nov 10 14:37:54 user nova-compute[75703]:       <doi>0</doi>
Nov 10 14:37:54 user nova-compute[75703]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 14:37:54 user nova-compute[75703]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 14:37:54 user nova-compute[75703]:     </secmodel>
Nov 10 14:37:54 user nova-compute[75703]:   </host>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='alpha'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>clipper</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='armv6l'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>spitz</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>nuri</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>kzm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sx1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>z2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>tosa</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>n810</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>n800</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>terrier</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>midway</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>microbit</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>verdex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>highbank</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>akita</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>connex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>collie</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='armv7l'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>spitz</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>nuri</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>kzm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sx1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>z2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>tosa</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>n810</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>n800</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>terrier</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>midway</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>microbit</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>verdex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>highbank</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>akita</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>connex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>collie</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='aarch64'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>spitz</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>nuri</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>kzm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sx1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>z2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>tosa</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>n810</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>n800</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>terrier</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>midway</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>microbit</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>verdex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>highbank</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>akita</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>connex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>collie</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <acpi default='on' toggle='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='cris'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='i686'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>isapc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>microvm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='kvm'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <pae/>
Nov 10 14:37:54 user nova-compute[75703]:       <nonpae/>
Nov 10 14:37:54 user nova-compute[75703]:       <acpi default='on' toggle='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:       <apic default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='m68k'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>an5206</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>q800</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='microblaze'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='microblazeel'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='mips'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='16'>malta</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='mipsel'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='16'>malta</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='mips64'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='16'>malta</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>pica61</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>magnum</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='mips64el'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='16'>malta</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>pica61</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>magnum</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='16'>boston</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='ppc'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mac99</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>40p</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>taihu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='ppc64'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>taihu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>40p</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mac99</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='ppc64le'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>taihu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>40p</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>mac99</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='riscv32'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='8'>spike</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='8'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='riscv64'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='8'>spike</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='8'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='s390x'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='sh4'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>shix</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>r2d</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='sh4eb'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>shix</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>r2d</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='sparc'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>LX</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='sparc64'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>niagara</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='x86_64'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>64</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='1'>isapc</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>microvm</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='kvm'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <acpi default='on' toggle='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:       <apic default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='xtensa'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>sim</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>kc705</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ml605</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx200</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx60</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]:   <guest>
Nov 10 14:37:54 user nova-compute[75703]:     <os_type>hvm</os_type>
Nov 10 14:37:54 user nova-compute[75703]:     <arch name='xtensaeb'>
Nov 10 14:37:54 user nova-compute[75703]:       <wordsize>32</wordsize>
Nov 10 14:37:54 user nova-compute[75703]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='4'>sim</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>kc705</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ml605</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>virt</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx200</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>lx60</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 14:37:54 user nova-compute[75703]:       <domain type='qemu'/>
Nov 10 14:37:54 user nova-compute[75703]:     </arch>
Nov 10 14:37:54 user nova-compute[75703]:     <features>
Nov 10 14:37:54 user nova-compute[75703]:       <cpuselection/>
Nov 10 14:37:54 user nova-compute[75703]:       <deviceboot/>
Nov 10 14:37:54 user nova-compute[75703]:       <disksnapshot default='on' toggle='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     </features>
Nov 10 14:37:54 user nova-compute[75703]:   </guest>
Nov 10 14:37:54 user nova-compute[75703]: </capabilities>
Nov 10 14:37:54 user nova-compute[75703]: 
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-i440fx-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>i686</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='255'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'/>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='lm'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ide</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-q35-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>i686</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='288'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'/>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='lm'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-q35-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>i686</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='288'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'/>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='lm'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-i440fx-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>i686</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='255'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'/>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='lm'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ide</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-i440fx-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>x86_64</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='255'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>efi</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='invtsc'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='rsba'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ide</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-q35-6.2</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>x86_64</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='288'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>efi</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='invtsc'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='rsba'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-q35-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>x86_64</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='288'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>efi</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='invtsc'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='rsba'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 14:37:54 user nova-compute[75703]: <domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 14:37:54 user nova-compute[75703]:   <domain>kvm</domain>
Nov 10 14:37:54 user nova-compute[75703]:   <machine>pc-i440fx-jammy</machine>
Nov 10 14:37:54 user nova-compute[75703]:   <arch>x86_64</arch>
Nov 10 14:37:54 user nova-compute[75703]:   <vcpu max='255'/>
Nov 10 14:37:54 user nova-compute[75703]:   <iothreads supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:   <os supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='firmware'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>efi</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:     <loader supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>rom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pflash</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='readonly'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>yes</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='secure'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>no</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </loader>
Nov 10 14:37:54 user nova-compute[75703]:   </os>
Nov 10 14:37:54 user nova-compute[75703]:   <cpu>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-passthrough' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='hostPassthroughMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='maximum' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='maximumMigratable'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>on</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>off</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='host-model' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <vendor>Intel</vendor>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ss'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='vmx'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pcid'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='hypervisor'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arat'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='umip'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='md-clear'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='invtsc'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibpb'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='ibrs'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-stibp'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='rsba'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='erms'/>
Nov 10 14:37:54 user nova-compute[75703]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:     <mode name='custom' supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>qemu64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>qemu32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>phenom</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>pentium</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>n270</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm64</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>kvm32</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>coreduo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>core2duo</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>athlon</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Westmere</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Snowridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Skylake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>SandyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Penryn</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G5</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G4</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G3</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Opteron_G2</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Opteron_G1</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>IvyBridge</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Icelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Haswell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Rome</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-Milan</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>EPYC</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Dhyana</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cooperlake</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>Conroe</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='no'>Broadwell</model>
Nov 10 14:37:54 user nova-compute[75703]:       <model usable='yes'>486</model>
Nov 10 14:37:54 user nova-compute[75703]:     </mode>
Nov 10 14:37:54 user nova-compute[75703]:   </cpu>
Nov 10 14:37:54 user nova-compute[75703]:   <memoryBacking supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:     <enum name='sourceType'>
Nov 10 14:37:54 user nova-compute[75703]:       <value>file</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>anonymous</value>
Nov 10 14:37:54 user nova-compute[75703]:       <value>memfd</value>
Nov 10 14:37:54 user nova-compute[75703]:     </enum>
Nov 10 14:37:54 user nova-compute[75703]:   </memoryBacking>
Nov 10 14:37:54 user nova-compute[75703]:   <devices>
Nov 10 14:37:54 user nova-compute[75703]:     <disk supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='diskDevice'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>disk</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cdrom</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>floppy</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>lun</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='bus'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ide</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>fdc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sata</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </disk>
Nov 10 14:37:54 user nova-compute[75703]:     <graphics supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='type'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>sdl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vnc</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>spice</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egl-headless</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </graphics>
Nov 10 14:37:54 user nova-compute[75703]:     <video supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='modelType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>cirrus</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>vmvga</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>qxl</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>none</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>bochs</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>ramfb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </video>
Nov 10 14:37:54 user nova-compute[75703]:     <hostdev supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='mode'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>subsystem</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='startupPolicy'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>default</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>mandatory</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>requisite</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>optional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='subsysType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>usb</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>pci</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>scsi</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='capsType'/>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='pciBackend'/>
Nov 10 14:37:54 user nova-compute[75703]:     </hostdev>
Nov 10 14:37:54 user nova-compute[75703]:     <rng supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtio-non-transitional</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>random</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>egd</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>builtin</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </rng>
Nov 10 14:37:54 user nova-compute[75703]:     <filesystem supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='driverType'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>path</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>handle</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>virtiofs</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </filesystem>
Nov 10 14:37:54 user nova-compute[75703]:     <tpm supported='yes'>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='model'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-tis</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>tpm-crb</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:       <enum name='backendModel'>
Nov 10 14:37:54 user nova-compute[75703]:         <value>passthrough</value>
Nov 10 14:37:54 user nova-compute[75703]:         <value>emulator</value>
Nov 10 14:37:54 user nova-compute[75703]:       </enum>
Nov 10 14:37:54 user nova-compute[75703]:     </tpm>
Nov 10 14:37:54 user nova-compute[75703]:   </devices>
Nov 10 14:37:54 user nova-compute[75703]:   <features>
Nov 10 14:37:54 user nova-compute[75703]:     <gic supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:     <vmcoreinfo supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <genid supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backingStoreInput supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <backup supported='yes'/>
Nov 10 14:37:54 user nova-compute[75703]:     <sev supported='no'/>
Nov 10 14:37:54 user nova-compute[75703]:   </features>
Nov 10 14:37:54 user nova-compute[75703]: </domainCapabilities>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75703) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75703) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Checking secure boot support for host arch (x86_64) {{(pid=75703) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Checking secure boot support for host arch (x86_64) {{(pid=75703) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Checking secure boot support for host arch (x86_64) {{(pid=75703) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 14:37:54 user nova-compute[75703]: INFO nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Secure Boot support detected
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] cpu compare xml: <cpu match="exact">
Nov 10 14:37:54 user nova-compute[75703]:   <model>Nehalem</model>
Nov 10 14:37:54 user nova-compute[75703]: </cpu>
Nov 10 14:37:54 user nova-compute[75703]:  {{(pid=75703) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 14:37:54 user nova-compute[75703]: INFO nova.virt.node [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Generated node identity 0d48b957-effe-4e84-b4fe-1da545e413ee
Nov 10 14:37:54 user nova-compute[75703]: INFO nova.virt.node [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Wrote node identity 0d48b957-effe-4e84-b4fe-1da545e413ee to /opt/stack/data/nova/compute_id
Nov 10 14:37:54 user nova-compute[75703]: WARNING nova.compute.manager [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Compute nodes ['0d48b957-effe-4e84-b4fe-1da545e413ee'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 14:37:54 user nova-compute[75703]: INFO nova.compute.manager [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 14:37:54 user nova-compute[75703]: WARNING nova.compute.manager [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 14:37:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:37:54 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:37:55 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:37:55 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Hypervisor/Node resource view: name=user free_ram=10923MB free_disk=26.11700439453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:37:55 user nova-compute[75703]: WARNING nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] No compute node record for user:0d48b957-effe-4e84-b4fe-1da545e413ee: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 0d48b957-effe-4e84-b4fe-1da545e413ee could not be found.
Nov 10 14:37:55 user nova-compute[75703]: INFO nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Compute node record created for user:user with uuid: 0d48b957-effe-4e84-b4fe-1da545e413ee
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:37:55 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] [req-2e6436a5-b1cc-4057-9ee7-94db14b4bfa8] Created resource provider record via placement API for resource provider with UUID 0d48b957-effe-4e84-b4fe-1da545e413ee and name user.
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75703) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 14:37:55 user nova-compute[75703]: INFO nova.virt.libvirt.host [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] kernel doesn't support AMD SEV
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Libvirt baseline CPU <cpu>
Nov 10 14:37:55 user nova-compute[75703]:   <arch>x86_64</arch>
Nov 10 14:37:55 user nova-compute[75703]:   <model>Nehalem</model>
Nov 10 14:37:55 user nova-compute[75703]:   <vendor>Intel</vendor>
Nov 10 14:37:55 user nova-compute[75703]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 14:37:55 user nova-compute[75703]: </cpu>
Nov 10 14:37:55 user nova-compute[75703]:  {{(pid=75703) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Updated inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Updating resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee generation from 0 to 1 during operation: update_inventory {{(pid=75703) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Updating resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee generation from 1 to 2 during operation: update_traits {{(pid=75703) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.service [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Creating RPC server for service compute {{(pid=75703) start /opt/stack/nova/nova/service.py:182}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.service [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] Join ServiceGroup membership for this service compute {{(pid=75703) start /opt/stack/nova/nova/service.py:199}}
Nov 10 14:37:55 user nova-compute[75703]: DEBUG nova.servicegroup.drivers.db [None req-329b1a36-5ad7-41b8-baf0-6c47303bb2ba None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75703) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_power_states {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:38:50 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:38:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:38:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:38:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=26.020843505859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:38:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:39:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:39:48 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:39:49 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:39:49 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:39:49 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=26.073570251464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:39:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:40:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:40:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:40:49 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:40:50 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:40:50 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:40:50 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=10289MB free_disk=25.837604522705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:40:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:40:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:40:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:41:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:50 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:41:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:41:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:41:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9575MB free_disk=25.864933013916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:41:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:52 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:41:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:52 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:41:52 user nova-compute[75703]: INFO nova.compute.claims [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Claim successful on node user
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:41:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:41:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Creating image(s)
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:54 user nova-compute[75703]: DEBUG nova.policy [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65434c01ab4a483a9875ac4d4dfb9993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5457f288fd44363b1ffc72ec62ee2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:41:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG nova.virt.images [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] 424c839a-ae27-4ecf-b640-8404a9fc9821 was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.part /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.part /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.converted" returned: 0 in 0.152s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.596s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:55 user nova-compute[75703]: INFO oslo.privsep.daemon [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj7n_jfzc/privsep.sock']
Nov 10 14:41:55 user sudo[84938]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj7n_jfzc/privsep.sock
Nov 10 14:41:55 user sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 14:41:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:41:56 user nova-compute[75703]: INFO nova.compute.claims [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Claim successful on node user
Nov 10 14:41:56 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Successfully created port: 745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:41:56 user sudo[84938]: pam_unix(sudo:session): session closed for user root
Nov 10 14:41:56 user nova-compute[75703]: INFO oslo.privsep.daemon [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Spawned new privsep daemon via rootwrap
Nov 10 14:41:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 14:41:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 14:41:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 14:41:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84949
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:41:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.policy [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28a7ce6177324febb76e7345d5f806d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a280413e809f4f128f99529ea919692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:41:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Creating image(s)
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "/opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "/opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.163s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk 1073741824" returned: 0 in 0.050s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk 1073741824" returned: 0 in 0.065s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Cannot resize image /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Ensure instance console log exists: /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.162s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:41:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Cannot resize image /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Ensure instance console log exists: /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:41:58 user nova-compute[75703]: INFO nova.compute.claims [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Claim successful on node user
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:41:58 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:41:58 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.policy [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90957e8164224a1285c067f0313178a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19b6b93f7b4e6dbe0ded4d084792f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:41:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Creating image(s)
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "/opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Successfully updated port: 745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.163s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk 1073741824" returned: 0 in 0.052s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Cannot resize image /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Ensure instance console log exists: /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:41:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-changed-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing instance network info cache due to event network-changed-745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Successfully created port: 92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance network_info: |[{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.network.neutron [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Start _get_guest_xml network_info=[{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:00 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-973695654',display_name='tempest-ServerStableDeviceRescueTest-server-973695654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-973695654',id=1,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB0V31H1LE0jq8ZHwwOYuY9dh6WAUutxUkKcEDq7GRuM71BtAMyAgvVfoaFDb5lhfiZ0xCHhSRBFq4A1BW68hQ1LJZ78+hhD/PbgkiPfmsJEGA9m9Uy6WStDohrTBc7pQ==',key_name='tempest-keypair-1749947703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5457f288fd44363b1ffc72ec62ee2ea',ramdisk_id='',reservation_id='r-yxtlxmkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-664853568',owner_user_name='tempest-ServerStableDeviceRescueTest-664853568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65434c01ab4a483a9875ac4d4dfb9993',uuid=fc1109cf-0cf6-4d87-8665-c7afc31edc90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converting VIF {"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'pci_devices' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Successfully created port: 53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:01 user nova-compute[75703]:   <uuid>fc1109cf-0cf6-4d87-8665-c7afc31edc90</uuid>
Nov 10 14:42:01 user nova-compute[75703]:   <name>instance-00000001</name>
Nov 10 14:42:01 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:01 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:01 user nova-compute[75703]:   <metadata>
Nov 10 14:42:01 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:01 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:01 user nova-compute[75703]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-973695654</nova:name>
Nov 10 14:42:01 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:00</nova:creationTime>
Nov 10 14:42:01 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:01 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:01 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:01 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:user uuid="65434c01ab4a483a9875ac4d4dfb9993">tempest-ServerStableDeviceRescueTest-664853568-project-member</nova:user>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:project uuid="c5457f288fd44363b1ffc72ec62ee2ea">tempest-ServerStableDeviceRescueTest-664853568</nova:project>
Nov 10 14:42:01 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:01 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:01 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:01 user nova-compute[75703]:         <nova:port uuid="745e6c01-21df-4938-b4de-de63abaafea2">
Nov 10 14:42:01 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 14:42:01 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:01 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:01 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:01 user nova-compute[75703]:   </metadata>
Nov 10 14:42:01 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:01 user nova-compute[75703]:     <system>
Nov 10 14:42:01 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:01 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:01 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:01 user nova-compute[75703]:       <entry name="serial">fc1109cf-0cf6-4d87-8665-c7afc31edc90</entry>
Nov 10 14:42:01 user nova-compute[75703]:       <entry name="uuid">fc1109cf-0cf6-4d87-8665-c7afc31edc90</entry>
Nov 10 14:42:01 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:01 user nova-compute[75703]:     </system>
Nov 10 14:42:01 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:01 user nova-compute[75703]:   <os>
Nov 10 14:42:01 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:01 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:01 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:01 user nova-compute[75703]:   </os>
Nov 10 14:42:01 user nova-compute[75703]:   <features>
Nov 10 14:42:01 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:01 user nova-compute[75703]:     <apic/>
Nov 10 14:42:01 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:01 user nova-compute[75703]:   </features>
Nov 10 14:42:01 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:01 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:01 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:01 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:01 user nova-compute[75703]:   </clock>
Nov 10 14:42:01 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:01 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:01 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:01 user nova-compute[75703]:   </cpu>
Nov 10 14:42:01 user nova-compute[75703]:   <devices>
Nov 10 14:42:01 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:01 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:01 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk"/>
Nov 10 14:42:01 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:01 user nova-compute[75703]:     </disk>
Nov 10 14:42:01 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:01 user nova-compute[75703]:       <mac address="fa:16:3e:cf:1a:b4"/>
Nov 10 14:42:01 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:01 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:01 user nova-compute[75703]:       <target dev="tap745e6c01-21"/>
Nov 10 14:42:01 user nova-compute[75703]:     </interface>
Nov 10 14:42:01 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:01 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/console.log" append="off"/>
Nov 10 14:42:01 user nova-compute[75703]:     </serial>
Nov 10 14:42:01 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:01 user nova-compute[75703]:     <video>
Nov 10 14:42:01 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:01 user nova-compute[75703]:     </video>
Nov 10 14:42:01 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:01 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:01 user nova-compute[75703]:     </rng>
Nov 10 14:42:01 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:01 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:01 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:01 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:01 user nova-compute[75703]:   </devices>
Nov 10 14:42:01 user nova-compute[75703]: </domain>
Nov 10 14:42:01 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-973695654',display_name='tempest-ServerStableDeviceRescueTest-server-973695654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-973695654',id=1,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB0V31H1LE0jq8ZHwwOYuY9dh6WAUutxUkKcEDq7GRuM71BtAMyAgvVfoaFDb5lhfiZ0xCHhSRBFq4A1BW68hQ1LJZ78+hhD/PbgkiPfmsJEGA9m9Uy6WStDohrTBc7pQ==',key_name='tempest-keypair-1749947703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5457f288fd44363b1ffc72ec62ee2ea',ramdisk_id='',reservation_id='r-yxtlxmkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-664853568',owner_user_name='tempest-ServerStableDeviceRescueTest-664853568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65434c01ab4a483a9875ac4d4dfb9993',uuid=fc1109cf-0cf6-4d87-8665-c7afc31edc90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converting VIF {"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG os_vif [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Created schema index Interface.name {{(pid=75703) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Created schema index Port.name {{(pid=75703) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Created schema index Bridge.name {{(pid=75703) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [POLLOUT] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a07a4e59-7b48-5c66-88d6-9ebefebdd40f', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:01 user nova-compute[75703]: INFO oslo.privsep.daemon [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpa0ioak9a/privsep.sock']
Nov 10 14:42:01 user sudo[85009]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpa0ioak9a/privsep.sock
Nov 10 14:42:01 user sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Successfully updated port: 92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquired lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-changed-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Refreshing instance network info cache due to event network-changed-92e0a985-ea49-43cd-8b65-bfe38643de86. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] Acquiring lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:02 user sudo[85009]: pam_unix(sudo:session): session closed for user root
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updated VIF entry in instance network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:02 user nova-compute[75703]: INFO oslo.privsep.daemon [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Spawned new privsep daemon via rootwrap
Nov 10 14:42:02 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 14:42:02 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 14:42:02 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 14:42:02 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85013
Nov 10 14:42:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b1a329a3-66b5-4a2a-9a66-e4db109fef85 req-e868713f-de55-4fe9-ac34-2058967447ad service nova] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "29e60285-ce7c-4b88-b013-458e19039808" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:42:03 user nova-compute[75703]: INFO nova.compute.claims [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Claim successful on node user
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745e6c01-21, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745e6c01-21, col_values=(('qos', UUID('1047a4fc-7810-4621-8d93-c5e6634878e4')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745e6c01-21, col_values=(('external_ids', {'iface-id': '745e6c01-21df-4938-b4de-de63abaafea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:1a:b4', 'vm-uuid': 'fc1109cf-0cf6-4d87-8665-c7afc31edc90'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: INFO os_vif [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21')
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updating instance_info_cache with network_info: [{"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Successfully updated port: 53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Releasing lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Instance network_info: |[{"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] Acquired lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Refreshing network info cache for port 92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Start _get_guest_xml network_info=[{"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No VIF found with MAC fa:16:3e:cf:1a:b4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:03 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:03 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1929656186',display_name='tempest-DeleteServersTestJSON-server-1929656186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1929656186',id=2,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a280413e809f4f128f99529ea919692d',ramdisk_id='',reservation_id='r-8wh56xfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-20255733',owner_user_name='tempest-DeleteServersTestJSON-20255733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:41:57Z,user_data=None,user_id='28a7ce6177324febb76e7345d5f806d9',uuid=aa81a0b3-cdb2-4618-97a7-743785e6c5bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Converting VIF {"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lazy-loading 'pci_devices' on Instance uuid aa81a0b3-cdb2-4618-97a7-743785e6c5bb {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:03 user nova-compute[75703]:   <uuid>aa81a0b3-cdb2-4618-97a7-743785e6c5bb</uuid>
Nov 10 14:42:03 user nova-compute[75703]:   <name>instance-00000002</name>
Nov 10 14:42:03 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:03 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:03 user nova-compute[75703]:   <metadata>
Nov 10 14:42:03 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:03 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:03 user nova-compute[75703]:       <nova:name>tempest-DeleteServersTestJSON-server-1929656186</nova:name>
Nov 10 14:42:03 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:03</nova:creationTime>
Nov 10 14:42:03 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:03 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:03 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:03 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:user uuid="28a7ce6177324febb76e7345d5f806d9">tempest-DeleteServersTestJSON-20255733-project-member</nova:user>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:project uuid="a280413e809f4f128f99529ea919692d">tempest-DeleteServersTestJSON-20255733</nova:project>
Nov 10 14:42:03 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:03 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:03 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:03 user nova-compute[75703]:         <nova:port uuid="92e0a985-ea49-43cd-8b65-bfe38643de86">
Nov 10 14:42:03 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 14:42:03 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:03 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:03 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:03 user nova-compute[75703]:   </metadata>
Nov 10 14:42:03 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:03 user nova-compute[75703]:     <system>
Nov 10 14:42:03 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:03 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:03 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:03 user nova-compute[75703]:       <entry name="serial">aa81a0b3-cdb2-4618-97a7-743785e6c5bb</entry>
Nov 10 14:42:03 user nova-compute[75703]:       <entry name="uuid">aa81a0b3-cdb2-4618-97a7-743785e6c5bb</entry>
Nov 10 14:42:03 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:03 user nova-compute[75703]:     </system>
Nov 10 14:42:03 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:03 user nova-compute[75703]:   <os>
Nov 10 14:42:03 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:03 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:03 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:03 user nova-compute[75703]:   </os>
Nov 10 14:42:03 user nova-compute[75703]:   <features>
Nov 10 14:42:03 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:03 user nova-compute[75703]:     <apic/>
Nov 10 14:42:03 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:03 user nova-compute[75703]:   </features>
Nov 10 14:42:03 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:03 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:03 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:03 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:03 user nova-compute[75703]:   </clock>
Nov 10 14:42:03 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:03 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:03 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:03 user nova-compute[75703]:   </cpu>
Nov 10 14:42:03 user nova-compute[75703]:   <devices>
Nov 10 14:42:03 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:03 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:03 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk"/>
Nov 10 14:42:03 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:03 user nova-compute[75703]:     </disk>
Nov 10 14:42:03 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:03 user nova-compute[75703]:       <mac address="fa:16:3e:49:7f:7a"/>
Nov 10 14:42:03 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:03 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:03 user nova-compute[75703]:       <target dev="tap92e0a985-ea"/>
Nov 10 14:42:03 user nova-compute[75703]:     </interface>
Nov 10 14:42:03 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:03 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/console.log" append="off"/>
Nov 10 14:42:03 user nova-compute[75703]:     </serial>
Nov 10 14:42:03 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:03 user nova-compute[75703]:     <video>
Nov 10 14:42:03 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:03 user nova-compute[75703]:     </video>
Nov 10 14:42:03 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:03 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:03 user nova-compute[75703]:     </rng>
Nov 10 14:42:03 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:03 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:03 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:03 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:03 user nova-compute[75703]:   </devices>
Nov 10 14:42:03 user nova-compute[75703]: </domain>
Nov 10 14:42:03 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1929656186',display_name='tempest-DeleteServersTestJSON-server-1929656186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1929656186',id=2,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a280413e809f4f128f99529ea919692d',ramdisk_id='',reservation_id='r-8wh56xfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-20255733',owner_user_name='tempest-DeleteServersTestJSON-20255733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:41:57Z,user_data=None,user_id='28a7ce6177324febb76e7345d5f806d9',uuid=aa81a0b3-cdb2-4618-97a7-743785e6c5bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Converting VIF {"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG os_vif [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0266032a-f992-58c6-8659-eb56cb8d30f3', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92e0a985-ea, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92e0a985-ea, col_values=(('qos', UUID('d4f734aa-2b31-4792-b783-9dc0db7f7edf')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92e0a985-ea, col_values=(('external_ids', {'iface-id': '92e0a985-ea49-43cd-8b65-bfe38643de86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:7f:7a', 'vm-uuid': 'aa81a0b3-cdb2-4618-97a7-743785e6c5bb'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:03 user nova-compute[75703]: INFO os_vif [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea')
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] No VIF found with MAC fa:16:3e:49:7f:7a, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.788s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-changed-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Refreshing instance network info cache due to event network-changed-53c7bac2-78b6-4148-836e-fd8c994d3d45. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] Acquiring lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:42:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:42:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Creating image(s)
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "/opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "/opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "/opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.239s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.policy [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37caa38086ae47a0be1d7f6f6a5aa6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf2404e273a4409ae3a1bb5d57eed08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.241s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Instance network_info: |[{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] Acquired lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.network.neutron [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Refreshing network info cache for port 53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Start _get_guest_xml network_info=[{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk 1073741824" returned: 0 in 0.076s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:42:04 user nova-compute[75703]: INFO nova.compute.claims [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Claim successful on node user
Nov 10 14:42:05 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:05 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114339608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114339608',id=3,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-hffz13db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:41:59Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=40c0bb3c-e83a-4d70-9299-a94c686cda28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'pci_devices' on Instance uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:05 user nova-compute[75703]:   <uuid>40c0bb3c-e83a-4d70-9299-a94c686cda28</uuid>
Nov 10 14:42:05 user nova-compute[75703]:   <name>instance-00000003</name>
Nov 10 14:42:05 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:05 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:05 user nova-compute[75703]:   <metadata>
Nov 10 14:42:05 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:05 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:05 user nova-compute[75703]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2114339608</nova:name>
Nov 10 14:42:05 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:05</nova:creationTime>
Nov 10 14:42:05 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:05 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:05 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:05 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:user uuid="90957e8164224a1285c067f0313178a2">tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member</nova:user>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:project uuid="6b19b6b93f7b4e6dbe0ded4d084792f2">tempest-ServerBootFromVolumeStableRescueTest-2023657370</nova:project>
Nov 10 14:42:05 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:05 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:05 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:05 user nova-compute[75703]:         <nova:port uuid="53c7bac2-78b6-4148-836e-fd8c994d3d45">
Nov 10 14:42:05 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 14:42:05 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:05 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:05 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:05 user nova-compute[75703]:   </metadata>
Nov 10 14:42:05 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:05 user nova-compute[75703]:     <system>
Nov 10 14:42:05 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:05 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:05 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:05 user nova-compute[75703]:       <entry name="serial">40c0bb3c-e83a-4d70-9299-a94c686cda28</entry>
Nov 10 14:42:05 user nova-compute[75703]:       <entry name="uuid">40c0bb3c-e83a-4d70-9299-a94c686cda28</entry>
Nov 10 14:42:05 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:05 user nova-compute[75703]:     </system>
Nov 10 14:42:05 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:05 user nova-compute[75703]:   <os>
Nov 10 14:42:05 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:05 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:05 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:05 user nova-compute[75703]:   </os>
Nov 10 14:42:05 user nova-compute[75703]:   <features>
Nov 10 14:42:05 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:05 user nova-compute[75703]:     <apic/>
Nov 10 14:42:05 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:05 user nova-compute[75703]:   </features>
Nov 10 14:42:05 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:05 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:05 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:05 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:05 user nova-compute[75703]:   </clock>
Nov 10 14:42:05 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:05 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:05 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:05 user nova-compute[75703]:   </cpu>
Nov 10 14:42:05 user nova-compute[75703]:   <devices>
Nov 10 14:42:05 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:05 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:05 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk"/>
Nov 10 14:42:05 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:05 user nova-compute[75703]:     </disk>
Nov 10 14:42:05 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:05 user nova-compute[75703]:       <mac address="fa:16:3e:3d:03:ec"/>
Nov 10 14:42:05 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:05 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:05 user nova-compute[75703]:       <target dev="tap53c7bac2-78"/>
Nov 10 14:42:05 user nova-compute[75703]:     </interface>
Nov 10 14:42:05 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:05 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/console.log" append="off"/>
Nov 10 14:42:05 user nova-compute[75703]:     </serial>
Nov 10 14:42:05 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:05 user nova-compute[75703]:     <video>
Nov 10 14:42:05 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:05 user nova-compute[75703]:     </video>
Nov 10 14:42:05 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:05 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:05 user nova-compute[75703]:     </rng>
Nov 10 14:42:05 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:05 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:05 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:05 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:05 user nova-compute[75703]:   </devices>
Nov 10 14:42:05 user nova-compute[75703]: </domain>
Nov 10 14:42:05 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114339608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114339608',id=3,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-hffz13db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:41:59Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=40c0bb3c-e83a-4d70-9299-a94c686cda28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG os_vif [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '387b927f-9c1f-5b9d-81d6-459477f21ee9', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53c7bac2-78, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53c7bac2-78, col_values=(('qos', UUID('befbf300-5a01-4fa9-a095-8e6e23d4de1d')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53c7bac2-78, col_values=(('external_ids', {'iface-id': '53c7bac2-78b6-4148-836e-fd8c994d3d45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:03:ec', 'vm-uuid': '40c0bb3c-e83a-4d70-9299-a94c686cda28'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: INFO os_vif [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78')
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Cannot resize image /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Ensure instance console log exists: /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No VIF found with MAC fa:16:3e:3d:03:ec, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.network.neutron [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:42:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:42:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Creating image(s)
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "/opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "/opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:05 user nova-compute[75703]: DEBUG nova.policy [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '838764a12310402d937f67bea06bbf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50238fe1407541f28120b08a92300102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.network.neutron [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updated VIF entry in instance network info cache for port 92e0a985-ea49-43cd-8b65-bfe38643de86. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.network.neutron [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updating instance_info_cache with network_info: [{"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2b3f6517-f4d2-4aff-a6b4-4fd7bc5adc26 req-659dba9f-9c8c-40bc-ab44-afc0f43b3a62 service nova] Releasing lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk 1073741824" returned: 0 in 0.055s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.network.neutron [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updated VIF entry in instance network info cache for port 53c7bac2-78b6-4148-836e-fd8c994d3d45. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.network.neutron [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4950d972-1504-4a87-92a1-e20f274a83e8 req-7c418e4a-c5b4-4267-96c7-3cba8267526c service nova] Releasing lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.231s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Cannot resize image /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Ensure instance console log exists: /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.025s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Successfully created port: 66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Successfully created port: 587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Successfully updated port: 66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquired lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received event network-changed-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Refreshing instance network info cache due to event network-changed-66eaee39-efc7-4e1c-a257-64994a368ce8. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] Acquiring lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Instance spawned successfully.
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Instance spawned successfully.
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance spawned successfully.
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Took 13.52 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Took 11.68 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Took 17.05 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:10 user nova-compute[75703]: INFO nova.compute.manager [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Took 14.36 seconds to build instance.
Nov 10 14:42:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f60a0139-6b3e-4f82-8ed6-072c8054cb5b tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.572s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:11 user nova-compute[75703]: INFO nova.compute.manager [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Took 12.60 seconds to build instance.
Nov 10 14:42:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a0c8b632-c73e-46a5-986b-91578d0c59c1 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.786s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:11 user nova-compute[75703]: INFO nova.compute.manager [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Took 18.43 seconds to build instance.
Nov 10 14:42:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5e79329b-28fd-48e5-b523-8492fe6b4565 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.713s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updating instance_info_cache with network_info: [{"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Releasing lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance network_info: |[{"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] Acquired lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.network.neutron [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Refreshing network info cache for port 66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Start _get_guest_xml network_info=[{"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437257266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437257266',id=4,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA24lZ2hsSeIty4z32YYMqnwrfr5rFEbPZSvaDL36fA6kke+Dkd7XvfMM8OSpAjZE1X+xVOpTpJfvIxadRTlWt2nCS8dSQYqHFXAG7YpYJdDUqtiZn2D/IlFNrdxDMTgvQ==',key_name='tempest-keypair-1657004935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-boxqgoo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=29e60285-ce7c-4b88-b013-458e19039808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'pci_devices' on Instance uuid 29e60285-ce7c-4b88-b013-458e19039808 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Successfully updated port: 587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:12 user nova-compute[75703]:   <uuid>29e60285-ce7c-4b88-b013-458e19039808</uuid>
Nov 10 14:42:12 user nova-compute[75703]:   <name>instance-00000004</name>
Nov 10 14:42:12 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:12 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:12 user nova-compute[75703]:   <metadata>
Nov 10 14:42:12 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:12 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:12 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-437257266</nova:name>
Nov 10 14:42:12 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:11</nova:creationTime>
Nov 10 14:42:12 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:12 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:12 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:12 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:user uuid="37caa38086ae47a0be1d7f6f6a5aa6d6">tempest-AttachVolumeShelveTestJSON-2134379644-project-member</nova:user>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:project uuid="baf2404e273a4409ae3a1bb5d57eed08">tempest-AttachVolumeShelveTestJSON-2134379644</nova:project>
Nov 10 14:42:12 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:12 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:12 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:12 user nova-compute[75703]:         <nova:port uuid="66eaee39-efc7-4e1c-a257-64994a368ce8">
Nov 10 14:42:12 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 14:42:12 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:12 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:12 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:12 user nova-compute[75703]:   </metadata>
Nov 10 14:42:12 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:12 user nova-compute[75703]:     <system>
Nov 10 14:42:12 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:12 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:12 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:12 user nova-compute[75703]:       <entry name="serial">29e60285-ce7c-4b88-b013-458e19039808</entry>
Nov 10 14:42:12 user nova-compute[75703]:       <entry name="uuid">29e60285-ce7c-4b88-b013-458e19039808</entry>
Nov 10 14:42:12 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:12 user nova-compute[75703]:     </system>
Nov 10 14:42:12 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:12 user nova-compute[75703]:   <os>
Nov 10 14:42:12 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:12 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:12 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:12 user nova-compute[75703]:   </os>
Nov 10 14:42:12 user nova-compute[75703]:   <features>
Nov 10 14:42:12 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:12 user nova-compute[75703]:     <apic/>
Nov 10 14:42:12 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:12 user nova-compute[75703]:   </features>
Nov 10 14:42:12 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:12 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:12 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:12 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:12 user nova-compute[75703]:   </clock>
Nov 10 14:42:12 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:12 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:12 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:12 user nova-compute[75703]:   </cpu>
Nov 10 14:42:12 user nova-compute[75703]:   <devices>
Nov 10 14:42:12 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:12 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:12 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk"/>
Nov 10 14:42:12 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:12 user nova-compute[75703]:     </disk>
Nov 10 14:42:12 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:12 user nova-compute[75703]:       <mac address="fa:16:3e:18:9e:cb"/>
Nov 10 14:42:12 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:12 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:12 user nova-compute[75703]:       <target dev="tap66eaee39-ef"/>
Nov 10 14:42:12 user nova-compute[75703]:     </interface>
Nov 10 14:42:12 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:12 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/console.log" append="off"/>
Nov 10 14:42:12 user nova-compute[75703]:     </serial>
Nov 10 14:42:12 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:12 user nova-compute[75703]:     <video>
Nov 10 14:42:12 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:12 user nova-compute[75703]:     </video>
Nov 10 14:42:12 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:12 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:12 user nova-compute[75703]:     </rng>
Nov 10 14:42:12 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:12 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:12 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:12 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:12 user nova-compute[75703]:   </devices>
Nov 10 14:42:12 user nova-compute[75703]: </domain>
Nov 10 14:42:12 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437257266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437257266',id=4,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA24lZ2hsSeIty4z32YYMqnwrfr5rFEbPZSvaDL36fA6kke+Dkd7XvfMM8OSpAjZE1X+xVOpTpJfvIxadRTlWt2nCS8dSQYqHFXAG7YpYJdDUqtiZn2D/IlFNrdxDMTgvQ==',key_name='tempest-keypair-1657004935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-boxqgoo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=29e60285-ce7c-4b88-b013-458e19039808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG os_vif [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquired lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '205f569d-60d6-5627-84d9-41cbb89be243', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66eaee39-ef, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66eaee39-ef, col_values=(('qos', UUID('291bde47-04b6-43ce-a10b-4324be5b9a04')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66eaee39-ef, col_values=(('external_ids', {'iface-id': '66eaee39-efc7-4e1c-a257-64994a368ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:9e:cb', 'vm-uuid': '29e60285-ce7c-4b88-b013-458e19039808'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:12 user nova-compute[75703]: INFO os_vif [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef')
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-changed-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Refreshing instance network info cache due to event network-changed-587cbad5-3ac6-4adf-ad70-7e2d0268e4be. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] Acquiring lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-04edd0bc-1594-4c7a-bb76-8e536c025602 req-85468b78-e690-48ae-92b5-ee967a923cd7 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-04edd0bc-1594-4c7a-bb76-8e536c025602 req-85468b78-e690-48ae-92b5-ee967a923cd7 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-04edd0bc-1594-4c7a-bb76-8e536c025602 req-85468b78-e690-48ae-92b5-ee967a923cd7 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-04edd0bc-1594-4c7a-bb76-8e536c025602 req-85468b78-e690-48ae-92b5-ee967a923cd7 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-04edd0bc-1594-4c7a-bb76-8e536c025602 req-85468b78-e690-48ae-92b5-ee967a923cd7 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:12 user nova-compute[75703]: WARNING nova.compute.manager [req-04edd0bc-1594-4c7a-bb76-8e536c025602 req-85468b78-e690-48ae-92b5-ee967a923cd7 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state active and task_state None.
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] No VIF found with MAC fa:16:3e:18:9e:cb, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updated VIF entry in instance network info cache for port 66eaee39-efc7-4e1c-a257-64994a368ce8. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updating instance_info_cache with network_info: [{"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2f19709c-f737-4d18-bba0-2dba3e354b72 req-eb1b0637-a0fe-4340-b76b-5a0c0ce0f260 service nova] Releasing lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Releasing lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance network_info: |[{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] Acquired lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Refreshing network info cache for port 587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Start _get_guest_xml network_info=[{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1906531598',display_name='tempest-ServerActionsTestOtherB-server-1906531598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1906531598',id=5,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARDx9Ux4B6BMgGtjVpZzzTTyYZVM+QY3vwtyHv2g+7qq0QV0W7vjrJ9snEFZTJ235/IL1eUdUTo80r4u6wGyIbuiqFuj+oekK9NlahHyizsxVRQGZ86TeYDK/xRsfJJLw==',key_name='tempest-keypair-930182833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50238fe1407541f28120b08a92300102',ramdisk_id='',reservation_id='r-5kalh1m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-830602594',owner_user_name='tempest-ServerActionsTestOtherB-830602594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='838764a12310402d937f67bea06bbf70',uuid=d4465989-c669-4edd-b7d2-f71e203b7142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converting VIF {"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:13 user nova-compute[75703]: DEBUG nova.objects.instance [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lazy-loading 'pci_devices' on Instance uuid d4465989-c669-4edd-b7d2-f71e203b7142 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:14 user nova-compute[75703]:   <uuid>d4465989-c669-4edd-b7d2-f71e203b7142</uuid>
Nov 10 14:42:14 user nova-compute[75703]:   <name>instance-00000005</name>
Nov 10 14:42:14 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:14 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:14 user nova-compute[75703]:   <metadata>
Nov 10 14:42:14 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:14 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:14 user nova-compute[75703]:       <nova:name>tempest-ServerActionsTestOtherB-server-1906531598</nova:name>
Nov 10 14:42:14 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:13</nova:creationTime>
Nov 10 14:42:14 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:14 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:14 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:14 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:user uuid="838764a12310402d937f67bea06bbf70">tempest-ServerActionsTestOtherB-830602594-project-member</nova:user>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:project uuid="50238fe1407541f28120b08a92300102">tempest-ServerActionsTestOtherB-830602594</nova:project>
Nov 10 14:42:14 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:14 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:14 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:14 user nova-compute[75703]:         <nova:port uuid="587cbad5-3ac6-4adf-ad70-7e2d0268e4be">
Nov 10 14:42:14 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 14:42:14 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:14 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:14 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:14 user nova-compute[75703]:   </metadata>
Nov 10 14:42:14 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:14 user nova-compute[75703]:     <system>
Nov 10 14:42:14 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:14 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:14 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:14 user nova-compute[75703]:       <entry name="serial">d4465989-c669-4edd-b7d2-f71e203b7142</entry>
Nov 10 14:42:14 user nova-compute[75703]:       <entry name="uuid">d4465989-c669-4edd-b7d2-f71e203b7142</entry>
Nov 10 14:42:14 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:14 user nova-compute[75703]:     </system>
Nov 10 14:42:14 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:14 user nova-compute[75703]:   <os>
Nov 10 14:42:14 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:14 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:14 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:14 user nova-compute[75703]:   </os>
Nov 10 14:42:14 user nova-compute[75703]:   <features>
Nov 10 14:42:14 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:14 user nova-compute[75703]:     <apic/>
Nov 10 14:42:14 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:14 user nova-compute[75703]:   </features>
Nov 10 14:42:14 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:14 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:14 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:14 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:14 user nova-compute[75703]:   </clock>
Nov 10 14:42:14 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:14 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:14 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:14 user nova-compute[75703]:   </cpu>
Nov 10 14:42:14 user nova-compute[75703]:   <devices>
Nov 10 14:42:14 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:14 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:14 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk"/>
Nov 10 14:42:14 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:14 user nova-compute[75703]:     </disk>
Nov 10 14:42:14 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:14 user nova-compute[75703]:       <mac address="fa:16:3e:c6:fe:4d"/>
Nov 10 14:42:14 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:14 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:14 user nova-compute[75703]:       <target dev="tap587cbad5-3a"/>
Nov 10 14:42:14 user nova-compute[75703]:     </interface>
Nov 10 14:42:14 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:14 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/console.log" append="off"/>
Nov 10 14:42:14 user nova-compute[75703]:     </serial>
Nov 10 14:42:14 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:14 user nova-compute[75703]:     <video>
Nov 10 14:42:14 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:14 user nova-compute[75703]:     </video>
Nov 10 14:42:14 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:14 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:14 user nova-compute[75703]:     </rng>
Nov 10 14:42:14 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:14 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:14 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:14 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:14 user nova-compute[75703]:   </devices>
Nov 10 14:42:14 user nova-compute[75703]: </domain>
Nov 10 14:42:14 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1906531598',display_name='tempest-ServerActionsTestOtherB-server-1906531598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1906531598',id=5,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARDx9Ux4B6BMgGtjVpZzzTTyYZVM+QY3vwtyHv2g+7qq0QV0W7vjrJ9snEFZTJ235/IL1eUdUTo80r4u6wGyIbuiqFuj+oekK9NlahHyizsxVRQGZ86TeYDK/xRsfJJLw==',key_name='tempest-keypair-930182833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50238fe1407541f28120b08a92300102',ramdisk_id='',reservation_id='r-5kalh1m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-830602594',owner_user_name='tempest-ServerActionsTestOtherB-830602594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='838764a12310402d937f67bea06bbf70',uuid=d4465989-c669-4edd-b7d2-f71e203b7142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converting VIF {"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG os_vif [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79474fd9-86db-5fc5-ba6b-031eb8862a1d', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap587cbad5-3a, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap587cbad5-3a, col_values=(('qos', UUID('43512ca0-4c2d-41c8-ae51-16c5ca7f7d1d')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap587cbad5-3a, col_values=(('external_ids', {'iface-id': '587cbad5-3ac6-4adf-ad70-7e2d0268e4be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:fe:4d', 'vm-uuid': 'd4465989-c669-4edd-b7d2-f71e203b7142'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: INFO os_vif [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a')
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] No VIF found with MAC fa:16:3e:c6:fe:4d, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-5535b1dd-6c27-4cdc-ab5e-eba50b44aa94 req-424fb112-c890-4cbf-bec5-87c192ebe996 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5535b1dd-6c27-4cdc-ab5e-eba50b44aa94 req-424fb112-c890-4cbf-bec5-87c192ebe996 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5535b1dd-6c27-4cdc-ab5e-eba50b44aa94 req-424fb112-c890-4cbf-bec5-87c192ebe996 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5535b1dd-6c27-4cdc-ab5e-eba50b44aa94 req-424fb112-c890-4cbf-bec5-87c192ebe996 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-5535b1dd-6c27-4cdc-ab5e-eba50b44aa94 req-424fb112-c890-4cbf-bec5-87c192ebe996 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:14 user nova-compute[75703]: WARNING nova.compute.manager [req-5535b1dd-6c27-4cdc-ab5e-eba50b44aa94 req-424fb112-c890-4cbf-bec5-87c192ebe996 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state active and task_state None.
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updated VIF entry in instance network info cache for port 587cbad5-3ac6-4adf-ad70-7e2d0268e4be. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-373eb578-ff3e-49fb-9568-505e563b75a7 req-ac442ace-0f20-4e9d-8cc2-509af07d67a5 service nova] Releasing lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:19 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance spawned successfully.
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: INFO nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Took 15.80 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:20 user nova-compute[75703]: INFO nova.compute.manager [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Took 17.12 seconds to build instance.
Nov 10 14:42:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9da2e580-a55a-4d9d-a357-124001f32cd1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "29e60285-ce7c-4b88-b013-458e19039808" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.272s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance spawned successfully.
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:21 user nova-compute[75703]: INFO nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Took 15.15 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a8c0fef-0bf5-4bb5-906f-802704353942 req-1ecc0746-a1e7-4bff-b0bc-8ba624206d29 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a8c0fef-0bf5-4bb5-906f-802704353942 req-1ecc0746-a1e7-4bff-b0bc-8ba624206d29 service nova] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a8c0fef-0bf5-4bb5-906f-802704353942 req-1ecc0746-a1e7-4bff-b0bc-8ba624206d29 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a8c0fef-0bf5-4bb5-906f-802704353942 req-1ecc0746-a1e7-4bff-b0bc-8ba624206d29 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a8c0fef-0bf5-4bb5-906f-802704353942 req-1ecc0746-a1e7-4bff-b0bc-8ba624206d29 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] No waiting events found dispatching network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:21 user nova-compute[75703]: WARNING nova.compute.manager [req-7a8c0fef-0bf5-4bb5-906f-802704353942 req-1ecc0746-a1e7-4bff-b0bc-8ba624206d29 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received unexpected event network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be for instance with vm_state building and task_state spawning.
Nov 10 14:42:21 user nova-compute[75703]: INFO nova.compute.manager [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Took 16.39 seconds to build instance.
Nov 10 14:42:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-572b8546-1b41-4e20-8337-7ab55a6bbbac tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.588s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-8cb52822-e2be-4d07-b71a-032151c9d0ea req-5d437313-3767-4ee5-bd46-939c2830ab86 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8cb52822-e2be-4d07-b71a-032151c9d0ea req-5d437313-3767-4ee5-bd46-939c2830ab86 service nova] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8cb52822-e2be-4d07-b71a-032151c9d0ea req-5d437313-3767-4ee5-bd46-939c2830ab86 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8cb52822-e2be-4d07-b71a-032151c9d0ea req-5d437313-3767-4ee5-bd46-939c2830ab86 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-8cb52822-e2be-4d07-b71a-032151c9d0ea req-5d437313-3767-4ee5-bd46-939c2830ab86 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] No waiting events found dispatching network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:23 user nova-compute[75703]: WARNING nova.compute.manager [req-8cb52822-e2be-4d07-b71a-032151c9d0ea req-5d437313-3767-4ee5-bd46-939c2830ab86 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received unexpected event network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be for instance with vm_state active and task_state None.
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:42:23 user nova-compute[75703]: INFO nova.compute.claims [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Claim successful on node user
Nov 10 14:42:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-e9b593eb-bd03-471e-9a44-49be7f50d832 req-c08a159a-7167-429c-bdff-32884b48f8af service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received event network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9b593eb-bd03-471e-9a44-49be7f50d832 req-c08a159a-7167-429c-bdff-32884b48f8af service nova] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9b593eb-bd03-471e-9a44-49be7f50d832 req-c08a159a-7167-429c-bdff-32884b48f8af service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9b593eb-bd03-471e-9a44-49be7f50d832 req-c08a159a-7167-429c-bdff-32884b48f8af service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-e9b593eb-bd03-471e-9a44-49be7f50d832 req-c08a159a-7167-429c-bdff-32884b48f8af service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] No waiting events found dispatching network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:24 user nova-compute[75703]: WARNING nova.compute.manager [req-e9b593eb-bd03-471e-9a44-49be7f50d832 req-c08a159a-7167-429c-bdff-32884b48f8af service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received unexpected event network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 for instance with vm_state active and task_state None.
Nov 10 14:42:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.network.neutron [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:42:24 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:42:24 user nova-compute[75703]: DEBUG nova.policy [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a55f2945837465eb94a73d1399b52e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad107feaed514542a6e5e91073ed48f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:42:25 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Creating image(s)
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "/opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "/opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.242s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.445s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk 1073741824" returned: 0 in 0.138s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.611s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.network.neutron [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Successfully created port: a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-cc2f2d85-6a6e-4755-922c-ce46a11d9cc3 req-1cdb9ed6-ebcb-492d-aec3-8518a4b24714 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received event network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cc2f2d85-6a6e-4755-922c-ce46a11d9cc3 req-1cdb9ed6-ebcb-492d-aec3-8518a4b24714 service nova] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cc2f2d85-6a6e-4755-922c-ce46a11d9cc3 req-1cdb9ed6-ebcb-492d-aec3-8518a4b24714 service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cc2f2d85-6a6e-4755-922c-ce46a11d9cc3 req-1cdb9ed6-ebcb-492d-aec3-8518a4b24714 service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-cc2f2d85-6a6e-4755-922c-ce46a11d9cc3 req-1cdb9ed6-ebcb-492d-aec3-8518a4b24714 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] No waiting events found dispatching network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:26 user nova-compute[75703]: WARNING nova.compute.manager [req-cc2f2d85-6a6e-4755-922c-ce46a11d9cc3 req-1cdb9ed6-ebcb-492d-aec3-8518a4b24714 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received unexpected event network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 for instance with vm_state active and task_state None.
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.418s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Cannot resize image /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Ensure instance console log exists: /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:42:27 user nova-compute[75703]: INFO nova.compute.claims [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Claim successful on node user
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Successfully updated port: a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquired lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.798s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:42:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:42:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 14:42:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:42:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Creating image(s)
Nov 10 14:42:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "/opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "/opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "b0141c46734ea65f1a9cf1fe1316b74065cc6ee5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "b0141c46734ea65f1a9cf1fe1316b74065cc6ee5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG nova.policy [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0aaea6310b434bcf9c35b94ab2262f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b3313b480b4cdb9c2c3b27b97361b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:42:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating instance_info_cache with network_info: [{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-changed-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Refreshing instance network info cache due to event network-changed-a7e1e900-9023-40fb-bb13-83b8a61c7da0. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] Acquiring lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Releasing lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Instance network_info: |[{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] Acquired lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.network.neutron [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Refreshing network info cache for port a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Start _get_guest_xml network_info=[{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-835220917',display_name='tempest-VolumesAdminNegativeTest-server-835220917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-835220917',id=6,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD94JUXU1r3/tc5xaTVXQq5JqsotB5tiHCzjth4ZgCPX27XhHl4MCra+IstaZS7UiNX2QzBpUaO4F5uhDpjDSEsvtLNuEGkLcZAoZtXlwdK5lJtNafmmlJNBqaR075wv8A==',key_name='tempest-keypair-489795493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad107feaed514542a6e5e91073ed48f0',ramdisk_id='',reservation_id='r-q2g0jar0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18732562',owner_user_name='tempest-VolumesAdminNegativeTest-18732562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a55f2945837465eb94a73d1399b52e8',uuid=cc2a6989-8214-499a-b2d4-b8c88225a992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converting VIF {"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'pci_devices' on Instance uuid cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.part --force-share --output=json" returned: 0 in 0.267s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.images [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] fb148462-af70-418c-8126-ce805f9f5a27 was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.part /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:29 user nova-compute[75703]:   <uuid>cc2a6989-8214-499a-b2d4-b8c88225a992</uuid>
Nov 10 14:42:29 user nova-compute[75703]:   <name>instance-00000006</name>
Nov 10 14:42:29 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:29 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:29 user nova-compute[75703]:   <metadata>
Nov 10 14:42:29 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:29 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:29 user nova-compute[75703]:       <nova:name>tempest-VolumesAdminNegativeTest-server-835220917</nova:name>
Nov 10 14:42:29 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:29</nova:creationTime>
Nov 10 14:42:29 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:29 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:29 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:29 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:user uuid="9a55f2945837465eb94a73d1399b52e8">tempest-VolumesAdminNegativeTest-18732562-project-member</nova:user>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:project uuid="ad107feaed514542a6e5e91073ed48f0">tempest-VolumesAdminNegativeTest-18732562</nova:project>
Nov 10 14:42:29 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:29 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:29 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:29 user nova-compute[75703]:         <nova:port uuid="a7e1e900-9023-40fb-bb13-83b8a61c7da0">
Nov 10 14:42:29 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 14:42:29 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:29 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:29 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:29 user nova-compute[75703]:   </metadata>
Nov 10 14:42:29 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:29 user nova-compute[75703]:     <system>
Nov 10 14:42:29 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:29 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:29 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:29 user nova-compute[75703]:       <entry name="serial">cc2a6989-8214-499a-b2d4-b8c88225a992</entry>
Nov 10 14:42:29 user nova-compute[75703]:       <entry name="uuid">cc2a6989-8214-499a-b2d4-b8c88225a992</entry>
Nov 10 14:42:29 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:29 user nova-compute[75703]:     </system>
Nov 10 14:42:29 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:29 user nova-compute[75703]:   <os>
Nov 10 14:42:29 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:29 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:29 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:29 user nova-compute[75703]:   </os>
Nov 10 14:42:29 user nova-compute[75703]:   <features>
Nov 10 14:42:29 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:29 user nova-compute[75703]:     <apic/>
Nov 10 14:42:29 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:29 user nova-compute[75703]:   </features>
Nov 10 14:42:29 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:29 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:29 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:29 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:29 user nova-compute[75703]:   </clock>
Nov 10 14:42:29 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:29 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:29 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:29 user nova-compute[75703]:   </cpu>
Nov 10 14:42:29 user nova-compute[75703]:   <devices>
Nov 10 14:42:29 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:29 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:29 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk"/>
Nov 10 14:42:29 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:29 user nova-compute[75703]:     </disk>
Nov 10 14:42:29 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:29 user nova-compute[75703]:       <mac address="fa:16:3e:d4:39:ab"/>
Nov 10 14:42:29 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:29 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:29 user nova-compute[75703]:       <target dev="tapa7e1e900-90"/>
Nov 10 14:42:29 user nova-compute[75703]:     </interface>
Nov 10 14:42:29 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:29 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/console.log" append="off"/>
Nov 10 14:42:29 user nova-compute[75703]:     </serial>
Nov 10 14:42:29 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:29 user nova-compute[75703]:     <video>
Nov 10 14:42:29 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:29 user nova-compute[75703]:     </video>
Nov 10 14:42:29 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:29 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:29 user nova-compute[75703]:     </rng>
Nov 10 14:42:29 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:29 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:29 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:29 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:29 user nova-compute[75703]:   </devices>
Nov 10 14:42:29 user nova-compute[75703]: </domain>
Nov 10 14:42:29 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-835220917',display_name='tempest-VolumesAdminNegativeTest-server-835220917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-835220917',id=6,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD94JUXU1r3/tc5xaTVXQq5JqsotB5tiHCzjth4ZgCPX27XhHl4MCra+IstaZS7UiNX2QzBpUaO4F5uhDpjDSEsvtLNuEGkLcZAoZtXlwdK5lJtNafmmlJNBqaR075wv8A==',key_name='tempest-keypair-489795493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad107feaed514542a6e5e91073ed48f0',ramdisk_id='',reservation_id='r-q2g0jar0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18732562',owner_user_name='tempest-VolumesAdminNegativeTest-18732562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a55f2945837465eb94a73d1399b52e8',uuid=cc2a6989-8214-499a-b2d4-b8c88225a992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converting VIF {"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG os_vif [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5633187-fa46-5fdd-9c9c-b5cd76b13af7', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7e1e900-90, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7e1e900-90, col_values=(('qos', UUID('c04b208a-9c01-457a-b382-3529cf6422db')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7e1e900-90, col_values=(('external_ids', {'iface-id': 'a7e1e900-9023-40fb-bb13-83b8a61c7da0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:39:ab', 'vm-uuid': 'cc2a6989-8214-499a-b2d4-b8c88225a992'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:29 user nova-compute[75703]: INFO os_vif [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90')
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.part /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.converted" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No VIF found with MAC fa:16:3e:d4:39:ab, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5.converted --force-share --output=json" returned: 0 in 0.288s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "b0141c46734ea65f1a9cf1fe1316b74065cc6ee5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.588s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 --force-share --output=json" returned: 0 in 0.304s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "b0141c46734ea65f1a9cf1fe1316b74065cc6ee5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "b0141c46734ea65f1a9cf1fe1316b74065cc6ee5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.network.neutron [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updated VIF entry in instance network info cache for port a7e1e900-9023-40fb-bb13-83b8a61c7da0. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.network.neutron [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating instance_info_cache with network_info: [{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Successfully created port: cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 --force-share --output=json" returned: 0 in 0.249s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5,backing_fmt=raw /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b95ccdc4-9ad2-45f9-b068-3c01559a2b61 req-58621bd1-475c-4ff5-80c5-297c3fbb27f3 service nova] Releasing lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5,backing_fmt=raw /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk 1073741824" returned: 0 in 0.086s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "b0141c46734ea65f1a9cf1fe1316b74065cc6ee5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 --force-share --output=json" returned: 0 in 0.247s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Cannot resize image /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Ensure instance console log exists: /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Successfully updated port: cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquired lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-c011ff41-50ec-4207-a4d1-36d8f86972a6 req-605b7e15-cae8-46da-b6ce-e95e30ec4e59 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c011ff41-50ec-4207-a4d1-36d8f86972a6 req-605b7e15-cae8-46da-b6ce-e95e30ec4e59 service nova] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c011ff41-50ec-4207-a4d1-36d8f86972a6 req-605b7e15-cae8-46da-b6ce-e95e30ec4e59 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c011ff41-50ec-4207-a4d1-36d8f86972a6 req-605b7e15-cae8-46da-b6ce-e95e30ec4e59 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-c011ff41-50ec-4207-a4d1-36d8f86972a6 req-605b7e15-cae8-46da-b6ce-e95e30ec4e59 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] No waiting events found dispatching network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:31 user nova-compute[75703]: WARNING nova.compute.manager [req-c011ff41-50ec-4207-a4d1-36d8f86972a6 req-605b7e15-cae8-46da-b6ce-e95e30ec4e59 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received unexpected event network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 for instance with vm_state building and task_state spawning.
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-changed-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Refreshing instance network info cache due to event network-changed-cc950fa0-159b-45bc-a995-f601ea7fed01. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] Acquiring lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updating instance_info_cache with network_info: [{"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Releasing lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Instance network_info: |[{"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] Acquired lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Refreshing network info cache for port cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Start _get_guest_xml network_info=[{"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:42:17Z,direct_url=<?>,disk_format='qcow2',id=fb148462-af70-418c-8126-ce805f9f5a27,min_disk=0,min_ram=0,name='',owner='7adc8f944fe843008b9e4ac7c8543352',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:42:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': 'fb148462-af70-418c-8126-ce805f9f5a27'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:32 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:32 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:42:17Z,direct_url=<?>,disk_format='qcow2',id=fb148462-af70-418c-8126-ce805f9f5a27,min_disk=0,min_ram=0,name='',owner='7adc8f944fe843008b9e4ac7c8543352',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:42:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-553601083',display_name='tempest-AttachSCSIVolumeTestJSON-server-553601083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-553601083',id=7,image_ref='fb148462-af70-418c-8126-ce805f9f5a27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk+0be5r6KSpUGZGZrvEE7kQvNk8gASdWDGDlpvEM2ze5r5SIaAwtJuD+48EEjM3oT6aluEDWnl7RkeD3GUAEKPRx2mAR/pdzLwL5RGXIV39ZOpOdgi/CV/vdClZBAnwg==',key_name='tempest-keypair-432803700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30b3313b480b4cdb9c2c3b27b97361b7',ramdisk_id='',reservation_id='r-f1498cdc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb148462-af70-418c-8126-ce805f9f5a27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1805005288',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1805005288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aaea6310b434bcf9c35b94ab2262f21',uuid=2d61611e-951c-4789-87b4-44221eff8be7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Converting VIF {"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d61611e-951c-4789-87b4-44221eff8be7 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:32 user nova-compute[75703]:   <uuid>2d61611e-951c-4789-87b4-44221eff8be7</uuid>
Nov 10 14:42:32 user nova-compute[75703]:   <name>instance-00000007</name>
Nov 10 14:42:32 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:32 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:32 user nova-compute[75703]:   <metadata>
Nov 10 14:42:32 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:32 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:32 user nova-compute[75703]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-553601083</nova:name>
Nov 10 14:42:32 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:32</nova:creationTime>
Nov 10 14:42:32 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:32 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:32 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:32 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:user uuid="0aaea6310b434bcf9c35b94ab2262f21">tempest-AttachSCSIVolumeTestJSON-1805005288-project-member</nova:user>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:project uuid="30b3313b480b4cdb9c2c3b27b97361b7">tempest-AttachSCSIVolumeTestJSON-1805005288</nova:project>
Nov 10 14:42:32 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:32 user nova-compute[75703]:       <nova:root type="image" uuid="fb148462-af70-418c-8126-ce805f9f5a27"/>
Nov 10 14:42:32 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:32 user nova-compute[75703]:         <nova:port uuid="cc950fa0-159b-45bc-a995-f601ea7fed01">
Nov 10 14:42:32 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 14:42:32 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:32 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:32 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:32 user nova-compute[75703]:   </metadata>
Nov 10 14:42:32 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:32 user nova-compute[75703]:     <system>
Nov 10 14:42:32 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:32 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:32 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:32 user nova-compute[75703]:       <entry name="serial">2d61611e-951c-4789-87b4-44221eff8be7</entry>
Nov 10 14:42:32 user nova-compute[75703]:       <entry name="uuid">2d61611e-951c-4789-87b4-44221eff8be7</entry>
Nov 10 14:42:32 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:32 user nova-compute[75703]:     </system>
Nov 10 14:42:32 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:32 user nova-compute[75703]:   <os>
Nov 10 14:42:32 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:32 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:32 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:32 user nova-compute[75703]:   </os>
Nov 10 14:42:32 user nova-compute[75703]:   <features>
Nov 10 14:42:32 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:32 user nova-compute[75703]:     <apic/>
Nov 10 14:42:32 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:32 user nova-compute[75703]:   </features>
Nov 10 14:42:32 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:32 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:32 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:32 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:32 user nova-compute[75703]:   </clock>
Nov 10 14:42:32 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:32 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:32 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:32 user nova-compute[75703]:   </cpu>
Nov 10 14:42:32 user nova-compute[75703]:   <devices>
Nov 10 14:42:32 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:32 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:32 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk"/>
Nov 10 14:42:32 user nova-compute[75703]:       <target dev="sda" bus="scsi"/>
Nov 10 14:42:32 user nova-compute[75703]:       <address type="drive" controller="0" unit="0"/>
Nov 10 14:42:32 user nova-compute[75703]:     </disk>
Nov 10 14:42:32 user nova-compute[75703]:     <disk type="file" device="cdrom">
Nov 10 14:42:32 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 14:42:32 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.config"/>
Nov 10 14:42:32 user nova-compute[75703]:       <target dev="sdb" bus="scsi"/>
Nov 10 14:42:32 user nova-compute[75703]:       <address type="drive" controller="0" unit="1"/>
Nov 10 14:42:32 user nova-compute[75703]:     </disk>
Nov 10 14:42:32 user nova-compute[75703]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 14:42:32 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:32 user nova-compute[75703]:       <mac address="fa:16:3e:59:85:83"/>
Nov 10 14:42:32 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:32 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:32 user nova-compute[75703]:       <target dev="tapcc950fa0-15"/>
Nov 10 14:42:32 user nova-compute[75703]:     </interface>
Nov 10 14:42:32 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:32 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/console.log" append="off"/>
Nov 10 14:42:32 user nova-compute[75703]:     </serial>
Nov 10 14:42:32 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:32 user nova-compute[75703]:     <video>
Nov 10 14:42:32 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:32 user nova-compute[75703]:     </video>
Nov 10 14:42:32 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:32 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:32 user nova-compute[75703]:     </rng>
Nov 10 14:42:32 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:32 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:32 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:32 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:32 user nova-compute[75703]:   </devices>
Nov 10 14:42:32 user nova-compute[75703]: </domain>
Nov 10 14:42:32 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-553601083',display_name='tempest-AttachSCSIVolumeTestJSON-server-553601083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-553601083',id=7,image_ref='fb148462-af70-418c-8126-ce805f9f5a27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk+0be5r6KSpUGZGZrvEE7kQvNk8gASdWDGDlpvEM2ze5r5SIaAwtJuD+48EEjM3oT6aluEDWnl7RkeD3GUAEKPRx2mAR/pdzLwL5RGXIV39ZOpOdgi/CV/vdClZBAnwg==',key_name='tempest-keypair-432803700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30b3313b480b4cdb9c2c3b27b97361b7',ramdisk_id='',reservation_id='r-f1498cdc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb148462-af70-418c-8126-ce805f9f5a27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1805005288',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1805005288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aaea6310b434bcf9c35b94ab2262f21',uuid=2d61611e-951c-4789-87b4-44221eff8be7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Converting VIF {"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG os_vif [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae39a554-411f-56d4-be8d-19431b10a6ec', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc950fa0-15, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc950fa0-15, col_values=(('qos', UUID('97c420e7-a27a-48ee-b9a0-2f0b0dba0a5f')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc950fa0-15, col_values=(('external_ids', {'iface-id': 'cc950fa0-159b-45bc-a995-f601ea7fed01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:85:83', 'vm-uuid': '2d61611e-951c-4789-87b4-44221eff8be7'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:32 user nova-compute[75703]: INFO os_vif [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15')
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No BDM found with device name sda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No VIF found with MAC fa:16:3e:59:85:83, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:32 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Using config drive
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updated VIF entry in instance network info cache for port cc950fa0-159b-45bc-a995-f601ea7fed01. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updating instance_info_cache with network_info: [{"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1b0485fa-e62f-41ec-a1b0-40e41e3cf353 req-bece123f-6f77-4bae-9c00-7a7fcc7ea352 service nova] Releasing lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:33 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Creating config drive at /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.config
Nov 10 14:42:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqjzx0s8t {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqjzx0s8t" returned: 0 in 0.066s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-05be9dfb-afc2-4c23-8616-3dc8287c55a1 req-35aec444-fc8f-4f4a-86a9-fd5faca55444 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-05be9dfb-afc2-4c23-8616-3dc8287c55a1 req-35aec444-fc8f-4f4a-86a9-fd5faca55444 service nova] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-05be9dfb-afc2-4c23-8616-3dc8287c55a1 req-35aec444-fc8f-4f4a-86a9-fd5faca55444 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-05be9dfb-afc2-4c23-8616-3dc8287c55a1 req-35aec444-fc8f-4f4a-86a9-fd5faca55444 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-05be9dfb-afc2-4c23-8616-3dc8287c55a1 req-35aec444-fc8f-4f4a-86a9-fd5faca55444 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] No waiting events found dispatching network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:33 user nova-compute[75703]: WARNING nova.compute.manager [req-05be9dfb-afc2-4c23-8616-3dc8287c55a1 req-35aec444-fc8f-4f4a-86a9-fd5faca55444 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received unexpected event network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 for instance with vm_state building and task_state spawning.
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:33 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Instance spawned successfully.
Nov 10 14:42:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:34 user nova-compute[75703]: INFO nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Took 8.82 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:34 user nova-compute[75703]: INFO nova.compute.manager [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Took 10.66 seconds to build instance.
Nov 10 14:42:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-931cd889-fe5b-46a5-b878-2613f5e013a8 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.836s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:42:35 user nova-compute[75703]: INFO nova.compute.claims [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Claim successful on node user
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] No waiting events found dispatching network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:35 user nova-compute[75703]: WARNING nova.compute.manager [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received unexpected event network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 for instance with vm_state building and task_state spawning.
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] No waiting events found dispatching network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:35 user nova-compute[75703]: WARNING nova.compute.manager [req-f4add720-e42a-47b7-b272-2432b111f7ec req-4f1d6725-d8d5-43cd-9d87-155c9442a8a6 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received unexpected event network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 for instance with vm_state building and task_state spawning.
Nov 10 14:42:35 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:42:36 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.policy [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa3bd4acf9243ef8ffbe071ce8a0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '698862e14ebc43a89b13a956ee375c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:42:36 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Creating image(s)
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "/opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "/opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "/opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk 1073741824" returned: 0 in 0.058s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Successfully created port: afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Cannot resize image /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Ensure instance console log exists: /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Instance spawned successfully.
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Successfully updated port: afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquired lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:38 user nova-compute[75703]: INFO nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Took 9.95 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-changed-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Refreshing instance network info cache due to event network-changed-afef69d3-82f1-4b64-a61d-b86f908c1f19. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] Acquiring lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:38 user nova-compute[75703]: INFO nova.compute.manager [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Took 11.39 seconds to build instance.
Nov 10 14:42:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e26e6d6d-eaae-47c2-bd3c-59f085c90a89 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.568s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updating instance_info_cache with network_info: [{"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Releasing lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Instance network_info: |[{"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] Acquired lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Refreshing network info cache for port afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Start _get_guest_xml network_info=[{"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1285669186',display_name='tempest-TestVolumeSwap-server-1285669186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1285669186',id=8,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsHNsl8rVj8A9jSD7MH/Q9xG4ARbWOYyCFa132JW0AI8QWYDgNNc/sFeRHWlADHxpOy7YarEaS1OajWyM5iR7xHd2/dVhY0r0rwcgBsuaUjPOXn1LCJGHV8W3+zY/7KYA==',key_name='tempest-keypair-1665755306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='698862e14ebc43a89b13a956ee375c15',ramdisk_id='',reservation_id='r-3p1lol5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2111926738',owner_user_name='tempest-TestVolumeSwap-2111926738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa3bd4acf9243ef8ffbe071ce8a0180',uuid=edc4e407-e824-4ee7-831b-fe0bf2ac4293,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Converting VIF {"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lazy-loading 'pci_devices' on Instance uuid edc4e407-e824-4ee7-831b-fe0bf2ac4293 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:38 user nova-compute[75703]:   <uuid>edc4e407-e824-4ee7-831b-fe0bf2ac4293</uuid>
Nov 10 14:42:38 user nova-compute[75703]:   <name>instance-00000008</name>
Nov 10 14:42:38 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:38 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:38 user nova-compute[75703]:   <metadata>
Nov 10 14:42:38 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:38 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:38 user nova-compute[75703]:       <nova:name>tempest-TestVolumeSwap-server-1285669186</nova:name>
Nov 10 14:42:38 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:38</nova:creationTime>
Nov 10 14:42:38 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:38 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:38 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:38 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:user uuid="faa3bd4acf9243ef8ffbe071ce8a0180">tempest-TestVolumeSwap-2111926738-project-member</nova:user>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:project uuid="698862e14ebc43a89b13a956ee375c15">tempest-TestVolumeSwap-2111926738</nova:project>
Nov 10 14:42:38 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:38 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:38 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:38 user nova-compute[75703]:         <nova:port uuid="afef69d3-82f1-4b64-a61d-b86f908c1f19">
Nov 10 14:42:38 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:42:38 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:38 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:38 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:38 user nova-compute[75703]:   </metadata>
Nov 10 14:42:38 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:38 user nova-compute[75703]:     <system>
Nov 10 14:42:38 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:38 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:38 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:38 user nova-compute[75703]:       <entry name="serial">edc4e407-e824-4ee7-831b-fe0bf2ac4293</entry>
Nov 10 14:42:38 user nova-compute[75703]:       <entry name="uuid">edc4e407-e824-4ee7-831b-fe0bf2ac4293</entry>
Nov 10 14:42:38 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:38 user nova-compute[75703]:     </system>
Nov 10 14:42:38 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:38 user nova-compute[75703]:   <os>
Nov 10 14:42:38 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:38 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:38 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:38 user nova-compute[75703]:   </os>
Nov 10 14:42:38 user nova-compute[75703]:   <features>
Nov 10 14:42:38 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:38 user nova-compute[75703]:     <apic/>
Nov 10 14:42:38 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:38 user nova-compute[75703]:   </features>
Nov 10 14:42:38 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:38 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:38 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:38 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:38 user nova-compute[75703]:   </clock>
Nov 10 14:42:38 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:38 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:38 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:38 user nova-compute[75703]:   </cpu>
Nov 10 14:42:38 user nova-compute[75703]:   <devices>
Nov 10 14:42:38 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:38 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:38 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk"/>
Nov 10 14:42:38 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:38 user nova-compute[75703]:     </disk>
Nov 10 14:42:38 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:38 user nova-compute[75703]:       <mac address="fa:16:3e:d4:04:9b"/>
Nov 10 14:42:38 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:38 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:38 user nova-compute[75703]:       <target dev="tapafef69d3-82"/>
Nov 10 14:42:38 user nova-compute[75703]:     </interface>
Nov 10 14:42:38 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:38 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/console.log" append="off"/>
Nov 10 14:42:38 user nova-compute[75703]:     </serial>
Nov 10 14:42:38 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:38 user nova-compute[75703]:     <video>
Nov 10 14:42:38 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:38 user nova-compute[75703]:     </video>
Nov 10 14:42:38 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:38 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:38 user nova-compute[75703]:     </rng>
Nov 10 14:42:38 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:38 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:38 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:38 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:38 user nova-compute[75703]:   </devices>
Nov 10 14:42:38 user nova-compute[75703]: </domain>
Nov 10 14:42:38 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1285669186',display_name='tempest-TestVolumeSwap-server-1285669186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1285669186',id=8,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsHNsl8rVj8A9jSD7MH/Q9xG4ARbWOYyCFa132JW0AI8QWYDgNNc/sFeRHWlADHxpOy7YarEaS1OajWyM5iR7xHd2/dVhY0r0rwcgBsuaUjPOXn1LCJGHV8W3+zY/7KYA==',key_name='tempest-keypair-1665755306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='698862e14ebc43a89b13a956ee375c15',ramdisk_id='',reservation_id='r-3p1lol5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2111926738',owner_user_name='tempest-TestVolumeSwap-2111926738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa3bd4acf9243ef8ffbe071ce8a0180',uuid=edc4e407-e824-4ee7-831b-fe0bf2ac4293,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Converting VIF {"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG os_vif [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e0e2aaa-2f3d-5b35-b90f-bd6e007cb39a', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafef69d3-82, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafef69d3-82, col_values=(('qos', UUID('0286fd33-85a1-4e05-902d-521c01772ed4')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafef69d3-82, col_values=(('external_ids', {'iface-id': 'afef69d3-82f1-4b64-a61d-b86f908c1f19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:04:9b', 'vm-uuid': 'edc4e407-e824-4ee7-831b-fe0bf2ac4293'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:39 user nova-compute[75703]: INFO os_vif [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82')
Nov 10 14:42:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] No VIF found with MAC fa:16:3e:d4:04:9b, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-52eb692e-bb85-4437-a125-b11b59a0bcc8 req-2ee0a9c8-7680-424d-8eca-f69135439af1 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52eb692e-bb85-4437-a125-b11b59a0bcc8 req-2ee0a9c8-7680-424d-8eca-f69135439af1 service nova] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52eb692e-bb85-4437-a125-b11b59a0bcc8 req-2ee0a9c8-7680-424d-8eca-f69135439af1 service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52eb692e-bb85-4437-a125-b11b59a0bcc8 req-2ee0a9c8-7680-424d-8eca-f69135439af1 service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-52eb692e-bb85-4437-a125-b11b59a0bcc8 req-2ee0a9c8-7680-424d-8eca-f69135439af1 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] No waiting events found dispatching network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:39 user nova-compute[75703]: WARNING nova.compute.manager [req-52eb692e-bb85-4437-a125-b11b59a0bcc8 req-2ee0a9c8-7680-424d-8eca-f69135439af1 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received unexpected event network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 for instance with vm_state active and task_state None.
Nov 10 14:42:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updated VIF entry in instance network info cache for port afef69d3-82f1-4b64-a61d-b86f908c1f19. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updating instance_info_cache with network_info: [{"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bcfa490d-1e9b-4d06-b539-65cd7438225e req-a5268a25-2d50-421f-95c2-74cb326919f4 service nova] Releasing lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-3d78cf28-c22b-48c0-bc6f-02c54fb601eb req-f04be2ad-65eb-4fe3-8d2b-44fdd03f15d8 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3d78cf28-c22b-48c0-bc6f-02c54fb601eb req-f04be2ad-65eb-4fe3-8d2b-44fdd03f15d8 service nova] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3d78cf28-c22b-48c0-bc6f-02c54fb601eb req-f04be2ad-65eb-4fe3-8d2b-44fdd03f15d8 service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3d78cf28-c22b-48c0-bc6f-02c54fb601eb req-f04be2ad-65eb-4fe3-8d2b-44fdd03f15d8 service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-3d78cf28-c22b-48c0-bc6f-02c54fb601eb req-f04be2ad-65eb-4fe3-8d2b-44fdd03f15d8 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] No waiting events found dispatching network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:41 user nova-compute[75703]: WARNING nova.compute.manager [req-3d78cf28-c22b-48c0-bc6f-02c54fb601eb req-f04be2ad-65eb-4fe3-8d2b-44fdd03f15d8 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received unexpected event network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 for instance with vm_state building and task_state spawning.
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] No waiting events found dispatching network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:41 user nova-compute[75703]: WARNING nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received unexpected event network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 for instance with vm_state active and task_state None.
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] No waiting events found dispatching network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:41 user nova-compute[75703]: WARNING nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received unexpected event network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 for instance with vm_state active and task_state None.
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] No waiting events found dispatching network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:41 user nova-compute[75703]: WARNING nova.compute.manager [req-7973bc69-8b45-47e1-83bb-9c8f7f032b82 req-84643207-4ada-4035-9457-2724393a213d service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received unexpected event network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 for instance with vm_state active and task_state None.
Nov 10 14:42:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "b9927f87-7338-4b59-a675-d122ff035659" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:42:42 user nova-compute[75703]: INFO nova.compute.claims [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Claim successful on node user
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:42:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:42:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.policy [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4679e45903204f1b8df84225f1300644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '820d77927bb544368ff872e15ca7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:42:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Creating image(s)
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "/opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "/opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-52ddf18e-82c7-4c0a-95a4-950327217bc7 req-588046c4-5baa-464a-a300-b1ead2faed8b service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52ddf18e-82c7-4c0a-95a4-950327217bc7 req-588046c4-5baa-464a-a300-b1ead2faed8b service nova] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52ddf18e-82c7-4c0a-95a4-950327217bc7 req-588046c4-5baa-464a-a300-b1ead2faed8b service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52ddf18e-82c7-4c0a-95a4-950327217bc7 req-588046c4-5baa-464a-a300-b1ead2faed8b service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-52ddf18e-82c7-4c0a-95a4-950327217bc7 req-588046c4-5baa-464a-a300-b1ead2faed8b service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] No waiting events found dispatching network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:43 user nova-compute[75703]: WARNING nova.compute.manager [req-52ddf18e-82c7-4c0a-95a4-950327217bc7 req-588046c4-5baa-464a-a300-b1ead2faed8b service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received unexpected event network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 for instance with vm_state building and task_state spawning.
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Instance spawned successfully.
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.285s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk 1073741824" returned: 0 in 0.066s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:43 user nova-compute[75703]: INFO nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Took 7.45 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Successfully created port: d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:42:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:44 user nova-compute[75703]: INFO nova.compute.manager [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Took 8.70 seconds to build instance.
Nov 10 14:42:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30ee9427-d890-4663-93c8-299477a875de tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.872s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Cannot resize image /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Ensure instance console log exists: /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Successfully updated port: d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquired lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:42:44 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updating instance_info_cache with network_info: [{"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Releasing lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Instance network_info: |[{"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Start _get_guest_xml network_info=[{"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:42:45 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:45 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-605647709',display_name='tempest-VolumesAssistedSnapshotsTest-server-605647709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-605647709',id=9,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt9PSdNzidBgsqefKZvvc/mCyAWpMTfgvuESoHuFaPhlueOBdmm8RRUtG5J20WwqbqOqj02AJY6nh3DDCgiho+z5jZQZWU/bXQqUWsoAHqoqgoyzsM83JQIckJiHOf2uQ==',key_name='tempest-keypair-1299799377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='820d77927bb544368ff872e15ca7a1ad',ramdisk_id='',reservation_id='r-2nvytatg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-408670870',owner_user_name='tempest-VolumesAssistedSnapshotsTest-408670870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4679e45903204f1b8df84225f1300644',uuid=b9927f87-7338-4b59-a675-d122ff035659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Converting VIF {"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.objects.instance [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lazy-loading 'pci_devices' on Instance uuid b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:42:45 user nova-compute[75703]:   <uuid>b9927f87-7338-4b59-a675-d122ff035659</uuid>
Nov 10 14:42:45 user nova-compute[75703]:   <name>instance-00000009</name>
Nov 10 14:42:45 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:42:45 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:42:45 user nova-compute[75703]:   <metadata>
Nov 10 14:42:45 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:42:45 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:42:45 user nova-compute[75703]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-605647709</nova:name>
Nov 10 14:42:45 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:42:45</nova:creationTime>
Nov 10 14:42:45 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:42:45 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:42:45 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:42:45 user nova-compute[75703]:       <nova:owner>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:user uuid="4679e45903204f1b8df84225f1300644">tempest-VolumesAssistedSnapshotsTest-408670870-project-member</nova:user>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:project uuid="820d77927bb544368ff872e15ca7a1ad">tempest-VolumesAssistedSnapshotsTest-408670870</nova:project>
Nov 10 14:42:45 user nova-compute[75703]:       </nova:owner>
Nov 10 14:42:45 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:42:45 user nova-compute[75703]:       <nova:ports>
Nov 10 14:42:45 user nova-compute[75703]:         <nova:port uuid="d786df92-1b4e-4d6f-84da-9e5ac39a57a9">
Nov 10 14:42:45 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 14:42:45 user nova-compute[75703]:         </nova:port>
Nov 10 14:42:45 user nova-compute[75703]:       </nova:ports>
Nov 10 14:42:45 user nova-compute[75703]:     </nova:instance>
Nov 10 14:42:45 user nova-compute[75703]:   </metadata>
Nov 10 14:42:45 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:42:45 user nova-compute[75703]:     <system>
Nov 10 14:42:45 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:42:45 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:42:45 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:42:45 user nova-compute[75703]:       <entry name="serial">b9927f87-7338-4b59-a675-d122ff035659</entry>
Nov 10 14:42:45 user nova-compute[75703]:       <entry name="uuid">b9927f87-7338-4b59-a675-d122ff035659</entry>
Nov 10 14:42:45 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:42:45 user nova-compute[75703]:     </system>
Nov 10 14:42:45 user nova-compute[75703]:   </sysinfo>
Nov 10 14:42:45 user nova-compute[75703]:   <os>
Nov 10 14:42:45 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:42:45 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:42:45 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:42:45 user nova-compute[75703]:   </os>
Nov 10 14:42:45 user nova-compute[75703]:   <features>
Nov 10 14:42:45 user nova-compute[75703]:     <acpi/>
Nov 10 14:42:45 user nova-compute[75703]:     <apic/>
Nov 10 14:42:45 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:42:45 user nova-compute[75703]:   </features>
Nov 10 14:42:45 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:42:45 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:42:45 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:42:45 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:42:45 user nova-compute[75703]:   </clock>
Nov 10 14:42:45 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:42:45 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:42:45 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:42:45 user nova-compute[75703]:   </cpu>
Nov 10 14:42:45 user nova-compute[75703]:   <devices>
Nov 10 14:42:45 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:42:45 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:42:45 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk"/>
Nov 10 14:42:45 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:42:45 user nova-compute[75703]:     </disk>
Nov 10 14:42:45 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:42:45 user nova-compute[75703]:       <mac address="fa:16:3e:01:9b:a7"/>
Nov 10 14:42:45 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:45 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:42:45 user nova-compute[75703]:       <target dev="tapd786df92-1b"/>
Nov 10 14:42:45 user nova-compute[75703]:     </interface>
Nov 10 14:42:45 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:42:45 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/console.log" append="off"/>
Nov 10 14:42:45 user nova-compute[75703]:     </serial>
Nov 10 14:42:45 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:42:45 user nova-compute[75703]:     <video>
Nov 10 14:42:45 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:42:45 user nova-compute[75703]:     </video>
Nov 10 14:42:45 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:42:45 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:42:45 user nova-compute[75703]:     </rng>
Nov 10 14:42:45 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:42:45 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:42:45 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:42:45 user nova-compute[75703]:     </memballoon>
Nov 10 14:42:45 user nova-compute[75703]:   </devices>
Nov 10 14:42:45 user nova-compute[75703]: </domain>
Nov 10 14:42:45 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-605647709',display_name='tempest-VolumesAssistedSnapshotsTest-server-605647709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-605647709',id=9,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt9PSdNzidBgsqefKZvvc/mCyAWpMTfgvuESoHuFaPhlueOBdmm8RRUtG5J20WwqbqOqj02AJY6nh3DDCgiho+z5jZQZWU/bXQqUWsoAHqoqgoyzsM83JQIckJiHOf2uQ==',key_name='tempest-keypair-1299799377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='820d77927bb544368ff872e15ca7a1ad',ramdisk_id='',reservation_id='r-2nvytatg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-408670870',owner_user_name='tempest-VolumesAssistedSnapshotsTest-408670870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:42:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4679e45903204f1b8df84225f1300644',uuid=b9927f87-7338-4b59-a675-d122ff035659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Converting VIF {"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG os_vif [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5001d5ea-6620-577c-81b0-3ccf040a5bf3', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd786df92-1b, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd786df92-1b, col_values=(('qos', UUID('6a7918f2-852c-4e38-862b-ff678f3aa3e7')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd786df92-1b, col_values=(('external_ids', {'iface-id': 'd786df92-1b4e-4d6f-84da-9e5ac39a57a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:9b:a7', 'vm-uuid': 'b9927f87-7338-4b59-a675-d122ff035659'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:45 user nova-compute[75703]: INFO os_vif [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b')
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] No VIF found with MAC fa:16:3e:01:9b:a7, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-changed-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Refreshing instance network info cache due to event network-changed-d786df92-1b4e-4d6f-84da-9e5ac39a57a9. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] Acquiring lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] Acquired lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:45 user nova-compute[75703]: DEBUG nova.network.neutron [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Refreshing network info cache for port d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG nova.network.neutron [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updated VIF entry in instance network info cache for port d786df92-1b4e-4d6f-84da-9e5ac39a57a9. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG nova.network.neutron [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updating instance_info_cache with network_info: [{"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-750397aa-48a3-4ce0-be5c-113499b7a000 req-d10f4e6e-47ad-4049-a887-eb3a9737a9c0 service nova] Releasing lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 0 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 14:42:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-86afc445-98e5-4f5f-a410-34e0b7c2340d req-1c0a5a91-12a9-4288-98a0-bc6f51174aba service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-86afc445-98e5-4f5f-a410-34e0b7c2340d req-1c0a5a91-12a9-4288-98a0-bc6f51174aba service nova] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-86afc445-98e5-4f5f-a410-34e0b7c2340d req-1c0a5a91-12a9-4288-98a0-bc6f51174aba service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-86afc445-98e5-4f5f-a410-34e0b7c2340d req-1c0a5a91-12a9-4288-98a0-bc6f51174aba service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-86afc445-98e5-4f5f-a410-34e0b7c2340d req-1c0a5a91-12a9-4288-98a0-bc6f51174aba service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] No waiting events found dispatching network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:47 user nova-compute[75703]: WARNING nova.compute.manager [req-86afc445-98e5-4f5f-a410-34e0b7c2340d req-1c0a5a91-12a9-4288-98a0-bc6f51174aba service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received unexpected event network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 for instance with vm_state building and task_state spawning.
Nov 10 14:42:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-1597f932-3488-4d6a-90b2-ed2e688056b8 req-4ac1b7f1-fe38-4a26-bc27-bdf67a3b454f service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:42:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1597f932-3488-4d6a-90b2-ed2e688056b8 req-4ac1b7f1-fe38-4a26-bc27-bdf67a3b454f service nova] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1597f932-3488-4d6a-90b2-ed2e688056b8 req-4ac1b7f1-fe38-4a26-bc27-bdf67a3b454f service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1597f932-3488-4d6a-90b2-ed2e688056b8 req-4ac1b7f1-fe38-4a26-bc27-bdf67a3b454f service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-1597f932-3488-4d6a-90b2-ed2e688056b8 req-4ac1b7f1-fe38-4a26-bc27-bdf67a3b454f service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] No waiting events found dispatching network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:42:49 user nova-compute[75703]: WARNING nova.compute.manager [req-1597f932-3488-4d6a-90b2-ed2e688056b8 req-4ac1b7f1-fe38-4a26-bc27-bdf67a3b454f service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received unexpected event network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 for instance with vm_state building and task_state spawning.
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:42:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b9927f87-7338-4b59-a675-d122ff035659] Instance spawned successfully.
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:42:50 user nova-compute[75703]: INFO nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:50 user nova-compute[75703]: INFO nova.compute.manager [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Took 8.14 seconds to build instance.
Nov 10 14:42:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3288f2d6-e088-44df-b5dc-1dfd196c70b4 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "b9927f87-7338-4b59-a675-d122ff035659" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.300s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:42:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:42:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:42:57 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:57 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=25.545604705810547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance aa81a0b3-cdb2-4618-97a7-743785e6c5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d4465989-c669-4edd-b7d2-f71e203b7142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2d61611e-951c-4789-87b4-44221eff8be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:57 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b9927f87-7338-4b59-a675-d122ff035659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.914s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:42:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:42:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "5632da56-485f-4f52-8d59-59d908660a8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:30 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:43:30 user nova-compute[75703]: INFO nova.compute.claims [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Claim successful on node user
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:43:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.policy [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee49c0739fee4225b268b81a5a271abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8285dd3b302e414ab1af7fe6a452eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:43:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Creating image(s)
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "/opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "/opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "/opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Successfully created port: 7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk 1073741824" returned: 0 in 0.047s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:43:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Cannot resize image /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Ensure instance console log exists: /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Successfully updated port: 7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "refresh_cache-5632da56-485f-4f52-8d59-59d908660a8f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquired lock "refresh_cache-5632da56-485f-4f52-8d59-59d908660a8f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-changed-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Refreshing instance network info cache due to event network-changed-7d803d0c-9a80-4466-ac5e-0045ea19a988. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] Acquiring lock "refresh_cache-5632da56-485f-4f52-8d59-59d908660a8f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Updating instance_info_cache with network_info: [{"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Releasing lock "refresh_cache-5632da56-485f-4f52-8d59-59d908660a8f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Instance network_info: |[{"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] Acquired lock "refresh_cache-5632da56-485f-4f52-8d59-59d908660a8f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Refreshing network info cache for port 7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Start _get_guest_xml network_info=[{"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:43:32 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:43:32 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-312782401',display_name='tempest-VolumesActionsTest-instance-312782401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-312782401',id=10,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8285dd3b302e414ab1af7fe6a452eca4',ramdisk_id='',reservation_id='r-5bawfbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-482205440',owner_user_name='tempest-VolumesActionsTest-482205440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:43:31Z,user_data=None,user_id='ee49c0739fee4225b268b81a5a271abe',uuid=5632da56-485f-4f52-8d59-59d908660a8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converting VIF {"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lazy-loading 'pci_devices' on Instance uuid 5632da56-485f-4f52-8d59-59d908660a8f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:43:32 user nova-compute[75703]:   <uuid>5632da56-485f-4f52-8d59-59d908660a8f</uuid>
Nov 10 14:43:32 user nova-compute[75703]:   <name>instance-0000000a</name>
Nov 10 14:43:32 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:43:32 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:43:32 user nova-compute[75703]:   <metadata>
Nov 10 14:43:32 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:43:32 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:43:32 user nova-compute[75703]:       <nova:name>tempest-VolumesActionsTest-instance-312782401</nova:name>
Nov 10 14:43:32 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:43:32</nova:creationTime>
Nov 10 14:43:32 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:43:32 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:43:32 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:43:32 user nova-compute[75703]:       <nova:owner>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:user uuid="ee49c0739fee4225b268b81a5a271abe">tempest-VolumesActionsTest-482205440-project-member</nova:user>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:project uuid="8285dd3b302e414ab1af7fe6a452eca4">tempest-VolumesActionsTest-482205440</nova:project>
Nov 10 14:43:32 user nova-compute[75703]:       </nova:owner>
Nov 10 14:43:32 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:43:32 user nova-compute[75703]:       <nova:ports>
Nov 10 14:43:32 user nova-compute[75703]:         <nova:port uuid="7d803d0c-9a80-4466-ac5e-0045ea19a988">
Nov 10 14:43:32 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 14:43:32 user nova-compute[75703]:         </nova:port>
Nov 10 14:43:32 user nova-compute[75703]:       </nova:ports>
Nov 10 14:43:32 user nova-compute[75703]:     </nova:instance>
Nov 10 14:43:32 user nova-compute[75703]:   </metadata>
Nov 10 14:43:32 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:43:32 user nova-compute[75703]:     <system>
Nov 10 14:43:32 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:43:32 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:43:32 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:43:32 user nova-compute[75703]:       <entry name="serial">5632da56-485f-4f52-8d59-59d908660a8f</entry>
Nov 10 14:43:32 user nova-compute[75703]:       <entry name="uuid">5632da56-485f-4f52-8d59-59d908660a8f</entry>
Nov 10 14:43:32 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:43:32 user nova-compute[75703]:     </system>
Nov 10 14:43:32 user nova-compute[75703]:   </sysinfo>
Nov 10 14:43:32 user nova-compute[75703]:   <os>
Nov 10 14:43:32 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:43:32 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:43:32 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:43:32 user nova-compute[75703]:   </os>
Nov 10 14:43:32 user nova-compute[75703]:   <features>
Nov 10 14:43:32 user nova-compute[75703]:     <acpi/>
Nov 10 14:43:32 user nova-compute[75703]:     <apic/>
Nov 10 14:43:32 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:43:32 user nova-compute[75703]:   </features>
Nov 10 14:43:32 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:43:32 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:43:32 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:43:32 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:43:32 user nova-compute[75703]:   </clock>
Nov 10 14:43:32 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:43:32 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:43:32 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:43:32 user nova-compute[75703]:   </cpu>
Nov 10 14:43:32 user nova-compute[75703]:   <devices>
Nov 10 14:43:32 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:43:32 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:43:32 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk"/>
Nov 10 14:43:32 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:43:32 user nova-compute[75703]:     </disk>
Nov 10 14:43:32 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:43:32 user nova-compute[75703]:       <mac address="fa:16:3e:8c:11:69"/>
Nov 10 14:43:32 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:43:32 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:43:32 user nova-compute[75703]:       <target dev="tap7d803d0c-9a"/>
Nov 10 14:43:32 user nova-compute[75703]:     </interface>
Nov 10 14:43:32 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:43:32 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/console.log" append="off"/>
Nov 10 14:43:32 user nova-compute[75703]:     </serial>
Nov 10 14:43:32 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:43:32 user nova-compute[75703]:     <video>
Nov 10 14:43:32 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:43:32 user nova-compute[75703]:     </video>
Nov 10 14:43:32 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:43:32 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:43:32 user nova-compute[75703]:     </rng>
Nov 10 14:43:32 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:43:32 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:43:32 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:43:32 user nova-compute[75703]:     </memballoon>
Nov 10 14:43:32 user nova-compute[75703]:   </devices>
Nov 10 14:43:32 user nova-compute[75703]: </domain>
Nov 10 14:43:32 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-312782401',display_name='tempest-VolumesActionsTest-instance-312782401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-312782401',id=10,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8285dd3b302e414ab1af7fe6a452eca4',ramdisk_id='',reservation_id='r-5bawfbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-482205440',owner_user_name='tempest-VolumesActionsTest-482205440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:43:31Z,user_data=None,user_id='ee49c0739fee4225b268b81a5a271abe',uuid=5632da56-485f-4f52-8d59-59d908660a8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converting VIF {"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG os_vif [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ccc6f80-cdcb-5d91-8a7e-3794022d292b', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d803d0c-9a, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d803d0c-9a, col_values=(('qos', UUID('46fa2c2b-1f31-4ab3-947f-b338b3af3940')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d803d0c-9a, col_values=(('external_ids', {'iface-id': '7d803d0c-9a80-4466-ac5e-0045ea19a988', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:11:69', 'vm-uuid': '5632da56-485f-4f52-8d59-59d908660a8f'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:32 user nova-compute[75703]: INFO os_vif [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a')
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:43:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] No VIF found with MAC fa:16:3e:8c:11:69, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:43:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Updated VIF entry in instance network info cache for port 7d803d0c-9a80-4466-ac5e-0045ea19a988. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:43:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Updating instance_info_cache with network_info: [{"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:43:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-342b5a07-182e-4cc2-b19d-2b229e582675 req-83f4083e-bfae-4c27-8f0c-fb9faf3eec7c service nova] Releasing lock "refresh_cache-5632da56-485f-4f52-8d59-59d908660a8f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-a5a079d8-0c9b-4a7e-9be9-bca0cf818bb6 req-ca577715-bd95-4c02-8c10-eda752dd8444 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a5a079d8-0c9b-4a7e-9be9-bca0cf818bb6 req-ca577715-bd95-4c02-8c10-eda752dd8444 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a5a079d8-0c9b-4a7e-9be9-bca0cf818bb6 req-ca577715-bd95-4c02-8c10-eda752dd8444 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a5a079d8-0c9b-4a7e-9be9-bca0cf818bb6 req-ca577715-bd95-4c02-8c10-eda752dd8444 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-a5a079d8-0c9b-4a7e-9be9-bca0cf818bb6 req-ca577715-bd95-4c02-8c10-eda752dd8444 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:43:34 user nova-compute[75703]: WARNING nova.compute.manager [req-a5a079d8-0c9b-4a7e-9be9-bca0cf818bb6 req-ca577715-bd95-4c02-8c10-eda752dd8444 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state building and task_state spawning.
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:43:36 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Instance spawned successfully.
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:43:36 user nova-compute[75703]: INFO nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:43:36 user nova-compute[75703]: INFO nova.compute.manager [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Took 5.87 seconds to build instance.
Nov 10 14:43:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a1bbd1be-05b2-4683-af77-a8ecc86fad52 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "5632da56-485f-4f52-8d59-59d908660a8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.976s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-9f7b533f-b1ea-4294-897e-5a4f2ff52304 req-96f2a4c1-3a86-459e-b3da-213d70a1edb5 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9f7b533f-b1ea-4294-897e-5a4f2ff52304 req-96f2a4c1-3a86-459e-b3da-213d70a1edb5 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9f7b533f-b1ea-4294-897e-5a4f2ff52304 req-96f2a4c1-3a86-459e-b3da-213d70a1edb5 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9f7b533f-b1ea-4294-897e-5a4f2ff52304 req-96f2a4c1-3a86-459e-b3da-213d70a1edb5 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-9f7b533f-b1ea-4294-897e-5a4f2ff52304 req-96f2a4c1-3a86-459e-b3da-213d70a1edb5 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:43:36 user nova-compute[75703]: WARNING nova.compute.manager [req-9f7b533f-b1ea-4294-897e-5a4f2ff52304 req-96f2a4c1-3a86-459e-b3da-213d70a1edb5 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state active and task_state None.
Nov 10 14:43:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-changed-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing instance network info cache due to event network-changed-745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG nova.network.neutron [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG nova.network.neutron [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updated VIF entry in instance network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG nova.network.neutron [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:43:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6581483-0453-4b88-9739-e33c70d3c4ee req-0cedcd6c-4f15-4f89-b77c-37355c714ad5 service nova] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:43:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:43:44 user nova-compute[75703]: INFO nova.compute.manager [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] instance snapshotting
Nov 10 14:43:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Beginning live snapshot process
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.223s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbe3azawr/601da7b5a28f458f95fe50bdfd6f4b38.delta 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbe3azawr/601da7b5a28f458f95fe50bdfd6f4b38.delta 1073741824" returned: 0 in 0.056s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:45 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 14:43:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75703) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 14:43:45 user nova-compute[75703]: INFO nova.virt.libvirt.host [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] UEFI support detected
Nov 10 14:43:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:43:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:43:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 14:43:47 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:43:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbe3azawr/601da7b5a28f458f95fe50bdfd6f4b38.delta /opt/stack/data/nova/instances/snapshots/tmpbe3azawr/601da7b5a28f458f95fe50bdfd6f4b38 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbe3azawr/601da7b5a28f458f95fe50bdfd6f4b38.delta /opt/stack/data/nova/instances/snapshots/tmpbe3azawr/601da7b5a28f458f95fe50bdfd6f4b38" returned: 0 in 0.385s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Snapshot extracted, beginning image upload
Nov 10 14:43:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:43:49 user nova-compute[75703]: INFO nova.compute.manager [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] instance snapshotting
Nov 10 14:43:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Beginning live snapshot process
Nov 10 14:43:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json -f qcow2" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.303s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3z_7ibjf/8ce2f31005464ed9ba72094cb30d59ba.delta 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3z_7ibjf/8ce2f31005464ed9ba72094cb30d59ba.delta 1073741824" returned: 0 in 0.054s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:43:51 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Snapshot image upload complete
Nov 10 14:43:51 user nova-compute[75703]: INFO nova.compute.manager [None req-a45187a0-a0dd-44e4-8cb9-56b173899fb6 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Took 6.36 seconds to snapshot the instance on the hypervisor.
Nov 10 14:43:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] COPY block job progress, current cursor: 131072 final cursor: 75497472 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:43:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:43:52 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 14:43:52 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:43:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3z_7ibjf/8ce2f31005464ed9ba72094cb30d59ba.delta /opt/stack/data/nova/instances/snapshots/tmp3z_7ibjf/8ce2f31005464ed9ba72094cb30d59ba {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3z_7ibjf/8ce2f31005464ed9ba72094cb30d59ba.delta /opt/stack/data/nova/instances/snapshots/tmp3z_7ibjf/8ce2f31005464ed9ba72094cb30d59ba" returned: 0 in 0.272s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:52 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Snapshot extracted, beginning image upload
Nov 10 14:43:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG nova.objects.instance [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lazy-loading 'flavor' on Instance uuid aa81a0b3-cdb2-4618-97a7-743785e6c5bb {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:54 user nova-compute[75703]: INFO nova.compute.manager [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Attaching volume 75ad7486-dcda-4294-bc78-c0b483f67b96 to /dev/vdb
Nov 10 14:43:54 user nova-compute[75703]: DEBUG os_brick.utils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:43:54 user nova-compute[75703]: INFO oslo.privsep.daemon [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3dpss5oo/privsep.sock']
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:43:54 user sudo[87257]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3dpss5oo/privsep.sock
Nov 10 14:43:54 user sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 14:43:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updating instance_info_cache with network_info: [{"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received event network-changed-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Refreshing instance network info cache due to event network-changed-66eaee39-efc7-4e1c-a257-64994a368ce8. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] Acquiring lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] Acquired lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG nova.network.neutron [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Refreshing network info cache for port 66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-aa81a0b3-cdb2-4618-97a7-743785e6c5bb" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Snapshot image upload complete
Nov 10 14:43:55 user nova-compute[75703]: INFO nova.compute.manager [None req-d5fbc6ee-9efe-41f4-8fcc-1366ca729f11 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Took 6.36 seconds to snapshot the instance on the hypervisor.
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updated VIF entry in instance network info cache for port 66eaee39-efc7-4e1c-a257-64994a368ce8. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updating instance_info_cache with network_info: [{"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-81a9bb5c-68d2-4b42-9616-09b751d0d5d8 req-1a41fd30-6f2c-4c70-9523-3a645115b8e6 service nova] Releasing lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:43:56 user sudo[87257]: pam_unix(sudo:session): session closed for user root
Nov 10 14:43:56 user nova-compute[75703]: INFO oslo.privsep.daemon [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Spawned new privsep daemon via rootwrap
Nov 10 14:43:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 14:43:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 14:43:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 14:43:56 user nova-compute[75703]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87268
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d6bb02-03ca-479c-8e36-b53cc3c5fb63]: (2,) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-changed-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Refreshing instance network info cache due to event network-changed-587cbad5-3ac6-4adf-ad70-7e2d0268e4be. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] Acquiring lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] Acquired lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Refreshing network info cache for port 587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc95b7bd-8c7a-4707-9b67-7d6b21d76766]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:43:56 user nova-compute[75703]: WARNING os_brick.initiator.connectors.nvmeof [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2e524e-97e5-4f44-bad4-0296407a8e31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f0149f-093f-434f-9dce-c32080c51cea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[872acc03-f192-42c1-b3fd-454e68c406ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:43:56 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5c83ba-6c8f-436c-9e81-f6db4f8e76c0]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG os_brick.utils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] <== get_connector_properties: return (2421ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updating existing volume attachment record: 6bd4f849-4d37-40e1-bf8b-b11d91a886bb {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG nova.network.neutron [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updated VIF entry in instance network info cache for port 587cbad5-3ac6-4adf-ad70-7e2d0268e4be. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG nova.network.neutron [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ef6a6a3-0574-41e2-8b45-b6d284e79039 req-97fb5de7-1291-47f4-838c-a889c3e4393e service nova] Releasing lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:43:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:44:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7038MB free_disk=25.34024429321289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance aa81a0b3-cdb2-4618-97a7-743785e6c5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d4465989-c669-4edd-b7d2-f71e203b7142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2d61611e-951c-4789-87b4-44221eff8be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b9927f87-7338-4b59-a675-d122ff035659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5632da56-485f-4f52-8d59-59d908660a8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:44:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "29e60285-ce7c-4b88-b013-458e19039808" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:03 user nova-compute[75703]: INFO nova.compute.manager [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Shelving
Nov 10 14:44:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-10c48198-df41-4a05-8c95-2190361a2fb7 req-70f6c1c0-1f2b-46d2-ad87-9a8d91558c6a service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received event network-vif-unplugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-10c48198-df41-4a05-8c95-2190361a2fb7 req-70f6c1c0-1f2b-46d2-ad87-9a8d91558c6a service nova] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-10c48198-df41-4a05-8c95-2190361a2fb7 req-70f6c1c0-1f2b-46d2-ad87-9a8d91558c6a service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-10c48198-df41-4a05-8c95-2190361a2fb7 req-70f6c1c0-1f2b-46d2-ad87-9a8d91558c6a service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-10c48198-df41-4a05-8c95-2190361a2fb7 req-70f6c1c0-1f2b-46d2-ad87-9a8d91558c6a service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] No waiting events found dispatching network-vif-unplugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:44:03 user nova-compute[75703]: WARNING nova.compute.manager [req-10c48198-df41-4a05-8c95-2190361a2fb7 req-70f6c1c0-1f2b-46d2-ad87-9a8d91558c6a service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received unexpected event network-vif-unplugged-66eaee39-efc7-4e1c-a257-64994a368ce8 for instance with vm_state active and task_state shelving.
Nov 10 14:44:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance destroyed successfully.
Nov 10 14:44:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Beginning cold snapshot process
Nov 10 14:44:04 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:44:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk /opt/stack/data/nova/instances/snapshots/tmpv4vneq_3/1b258f7c71314791a39fbf18988e150b {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:44:05 user nova-compute[75703]: INFO nova.compute.claims [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Claim successful on node user
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808/disk /opt/stack/data/nova/instances/snapshots/tmpv4vneq_3/1b258f7c71314791a39fbf18988e150b" returned: 0 in 0.723s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Snapshot extracted, beginning image upload
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-a87e68b2-6449-43fe-a90e-f0488e4ce8ea req-d7a7fd2b-7c95-424d-8daa-1adce49b405b service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received event network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a87e68b2-6449-43fe-a90e-f0488e4ce8ea req-d7a7fd2b-7c95-424d-8daa-1adce49b405b service nova] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a87e68b2-6449-43fe-a90e-f0488e4ce8ea req-d7a7fd2b-7c95-424d-8daa-1adce49b405b service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a87e68b2-6449-43fe-a90e-f0488e4ce8ea req-d7a7fd2b-7c95-424d-8daa-1adce49b405b service nova] Lock "29e60285-ce7c-4b88-b013-458e19039808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-a87e68b2-6449-43fe-a90e-f0488e4ce8ea req-d7a7fd2b-7c95-424d-8daa-1adce49b405b service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] No waiting events found dispatching network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:44:05 user nova-compute[75703]: WARNING nova.compute.manager [req-a87e68b2-6449-43fe-a90e-f0488e4ce8ea req-d7a7fd2b-7c95-424d-8daa-1adce49b405b service nova] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Received unexpected event network-vif-plugged-66eaee39-efc7-4e1c-a257-64994a368ce8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:44:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:44:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:44:05 user nova-compute[75703]: INFO nova.virt.block_device [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Booting with volume db6a9681-ad81-4f01-b014-1462c614b6f4 at /dev/vda
Nov 10 14:44:06 user nova-compute[75703]: DEBUG nova.policy [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd23035d70a214b86a7717fd3031e6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f573a2d67c9949e2bae56d01a5ef5e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG os_brick.utils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbe504d-f822-4311-8951-6881541dbdb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099196a-ca44-4333-abf0-9bd04a01da88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d06faab-acd7-4c41-9116-19ca58fd6520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c627a6-bc36-4f83-a0bc-cd33aa907a3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:06 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:44:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[561643d5-0b88-4cb0-97d9-48843303b779]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG os_brick.utils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating existing volume attachment record: 30356a4d-7e14-4fb7-833f-33e04abe3122 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:44:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully created port: 86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:44:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully created port: e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:44:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully created port: 376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:44:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully created port: 6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:44:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Snapshot image upload complete
Nov 10 14:44:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:44:08 user nova-compute[75703]: INFO nova.compute.manager [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Shelve offloading
Nov 10 14:44:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance destroyed successfully.
Nov 10 14:44:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:44:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquired lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:44:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully created port: 1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:44:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updating instance_info_cache with network_info: [{"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Releasing lock "refresh_cache-29e60285-ce7c-4b88-b013-458e19039808" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: 86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-86926a35-7954-4ff2-8ff8-45f3252e9251. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port 86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:44:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance destroyed successfully.
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'resources' on Instance uuid 29e60285-ce7c-4b88-b013-458e19039808 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437257266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437257266',id=4,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA24lZ2hsSeIty4z32YYMqnwrfr5rFEbPZSvaDL36fA6kke+Dkd7XvfMM8OSpAjZE1X+xVOpTpJfvIxadRTlWt2nCS8dSQYqHFXAG7YpYJdDUqtiZn2D/IlFNrdxDMTgvQ==',key_name='tempest-keypair-1657004935',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-boxqgoo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member',shelved_at='2023-11-10T14:44:08.499402',shelved_host='user',shelved_image_id='74fc3322-b4eb-483c-969b-a1725c5810db'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=29e60285-ce7c-4b88-b013-458e19039808,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "66eaee39-efc7-4e1c-a257-64994a368ce8", "address": "fa:16:3e:18:9e:cb", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66eaee39-ef", "ovs_interfaceid": "66eaee39-efc7-4e1c-a257-64994a368ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG os_vif [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66eaee39-ef, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=291bde47-04b6-43ce-a10b-4324be5b9a04) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:10 user nova-compute[75703]: INFO os_vif [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:9e:cb,bridge_name='br-int',has_traffic_filtering=True,id=66eaee39-efc7-4e1c-a257-64994a368ce8,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66eaee39-ef')
Nov 10 14:44:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Deleting instance files /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808_del
Nov 10 14:44:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Deletion of /opt/stack/data/nova/instances/29e60285-ce7c-4b88-b013-458e19039808_del complete
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b38a7702-39a8-4f6c-a459-88425951eee7 req-f0f7b2d3-2dac-4e00-a69d-db4ae4a41d4f service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:10 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Deleted allocations for instance 29e60285-ce7c-4b88-b013-458e19039808
Nov 10 14:44:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'numa_topology' on Instance uuid 29e60285-ce7c-4b88-b013-458e19039808 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.objects.base [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Object Instance<29e60285-ce7c-4b88-b013-458e19039808> lazy-loaded attributes: resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: 12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:44:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dcbea338-c3ed-452c-8790-687585f9a171 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "29e60285-ce7c-4b88-b013-458e19039808" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.770s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port 12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-f8f4b90a-cf48-4bbe-bd55-868e5893ae04. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: 376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c4733d4-9b6a-455e-9d94-1e26b36cdfa1 req-41bd89c3-9edf-410e-8bd0-8397ed214243 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: 6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Successfully updated port: 1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:44:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:44:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-376356e9-1d11-4a3b-a897-3f8442b1ba3c. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:44:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance network_info: |[{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port 376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-changed-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Refreshing instance network info cache due to event network-changed-a7e1e900-9023-40fb-bb13-83b8a61c7da0. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] Acquiring lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] Acquired lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Refreshing network info cache for port a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updated VIF entry in instance network info cache for port 376356e9-1d11-4a3b-a897-3f8442b1ba3c. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-6927009b-f303-4652-8a2c-7aa4ca693b8f. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port 6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updated VIF entry in instance network info cache for port a7e1e900-9023-40fb-bb13-83b8a61c7da0. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating instance_info_cache with network_info: [{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-00a950df-e727-4435-96c8-b5da689173ea req-dbe1ca3a-1669-45a9-b903-da4dfa20139b service nova] Releasing lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updated VIF entry in instance network info cache for port 6927009b-f303-4652-8a2c-7aa4ca693b8f. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-1cd61549-3867-4279-842a-38dbfa9669f8. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port 1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updated VIF entry in instance network info cache for port 1cd61549-3867-4279-842a-38dbfa9669f8. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2052835b-17e3-4d9f-96cb-7ec91b36d9a6 req-af464cdd-1529-42fe-913e-25cd7b6545a5 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-changed-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Refreshing instance network info cache due to event network-changed-cc950fa0-159b-45bc-a995-f601ea7fed01. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] Acquiring lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] Acquired lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Refreshing network info cache for port cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:18 user nova-compute[75703]: DEBUG nova.network.neutron [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updated VIF entry in instance network info cache for port cc950fa0-159b-45bc-a995-f601ea7fed01. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:18 user nova-compute[75703]: DEBUG nova.network.neutron [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updating instance_info_cache with network_info: [{"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1d3b0099-25a2-4f3a-bedf-f22059d378da req-74106609-9fec-4bee-a452-1758ecc51840 service nova] Releasing lock "refresh_cache-2d61611e-951c-4789-87b4-44221eff8be7" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-changed-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Refreshing instance network info cache due to event network-changed-afef69d3-82f1-4b64-a61d-b86f908c1f19. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] Acquiring lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] Acquired lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Refreshing network info cache for port afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.objects.instance [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lazy-loading 'flavor' on Instance uuid edc4e407-e824-4ee7-831b-fe0bf2ac4293 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updated VIF entry in instance network info cache for port afef69d3-82f1-4b64-a61d-b86f908c1f19. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updating instance_info_cache with network_info: [{"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ae3042f9-4743-47ba-8b01-582579a4dcb3 req-f2c37f62-b57e-4605-8a18-7d9361e5fa3d service nova] Releasing lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:26 user nova-compute[75703]: INFO nova.compute.manager [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Attaching volume 5f509b52-467a-4e64-888d-b79c8a9d1612 to /dev/vdb
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.utils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953efdc-2527-4515-b78e-99a97b1afd99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d22c017-afe0-4421-bbcb-91d5c76519ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac145805-4ad2-4a68-b30d-02f8a0bd8f0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9debe89-e5fe-43c8-8a86-a1ea20ee0060]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:26 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb85c718-b2a7-4775-b8b9-9c36fac8053c]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.utils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updating existing volume attachment record: 824ec2df-268b-4c40-9c93-fbaf113d8925 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connector [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Factory for ISCSI on None {{(pid=75703) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkgGAmWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:44:26 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:44:26 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:44:26 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc4da3-ef0d-4ccc-a552-408d1277485b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:44:26 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a726ed8-57ed-400b-9649-8daa87f4dd53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96] added
Nov 10 14:44:26 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd745383-4690-49d4-875c-b8241eccb742]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[05710edb-74f3-48c2-8395-c45fdb76dac2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkgGAmWj {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkgGAmWj" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193fe21-a335-47dc-9c68-353e4ebcc989]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkgGAmWj'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9017ff6d-a0a9-46c2-8a83-326caf31a4d3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde96afa-9b41-4083-ace4-71b32263eb27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 14:44:27 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 14:44:27 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:44:27 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 14:44:27 user nova-compute[75703]: 
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG nova.objects.instance [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'flavor' on Instance uuid cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf90b688-ea20-445c-a03e-57f8087dc4a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260]
Nov 10 14:44:27 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260] successful.
Nov 10 14:44:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c087a-de98-4610-80ca-0999e8ea1b5e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[512dae3f-3349-45f7-87d2-e8e01cdbc7dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 (non-flash)
Nov 10 14:44:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 (non-flash)
Nov 10 14:44:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d06652-4883-4c1f-b84f-7879b1548d9f]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkgGAmWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:27 user nova-compute[75703]: INFO nova.compute.manager [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Attaching volume 342876fd-d96b-4d0c-a44f-5524e79ec40f to /dev/vdb
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.utils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c5d6ec-b59b-4515-b43c-7dc9c29b17f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc61e4-e9af-455a-921d-25deefcb8733]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[05145446-0f97-4c5a-b55a-2726dea43f31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba75f4-81ee-44c0-9f02-3eacb120d288]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:27 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:44:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf783693-0b11-48ab-99c2-0236c6c09ee0]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG os_brick.utils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:44:27 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating existing volume attachment record: 7ae756d5-12b3-406b-ace0-e8de1bcdb72a {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26539313137373436', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539313137373436', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG nova.objects.instance [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lazy-loading 'flavor' on Instance uuid aa81a0b3-cdb2-4618-97a7-743785e6c5bb {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:44:28 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:44:28 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:44:28 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:44:28 user nova-compute[75703]:   <serial>75ad7486-dcda-4294-bc78-c0b483f67b96</serial>
Nov 10 14:44:28 user nova-compute[75703]: </disk>
Nov 10 14:44:28 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] No VIF found with MAC fa:16:3e:49:7f:7a, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:44:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-changed-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:44:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Refreshing instance network info cache due to event network-changed-d786df92-1b4e-4d6f-84da-9e5ac39a57a9. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:44:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] Acquiring lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] Acquired lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Refreshing network info cache for port d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:44:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updated VIF entry in instance network info cache for port d786df92-1b4e-4d6f-84da-9e5ac39a57a9. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:44:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updating instance_info_cache with network_info: [{"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f2b1a74a-3f0c-4053-9540-e56fee79aa89 req-9dcec3e5-9997-4efe-b890-8b828fe2d889 service nova] Releasing lock "refresh_cache-b9927f87-7338-4b59-a675-d122ff035659" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87abbaa0-fd33-4166-a8ec-2b7c3ebb42af tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.608s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "b9927f87-7338-4b59-a675-d122ff035659" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lazy-loading 'flavor' on Instance uuid b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:35 user nova-compute[75703]: INFO nova.virt.block_device [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Booting with volume be94a23c-71a0-4038-b3ab-e6cbc390a4f4 at /dev/vdb
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "b9927f87-7338-4b59-a675-d122ff035659" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lazy-loading 'flavor' on Instance uuid 2d61611e-951c-4789-87b4-44221eff8be7 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG os_brick.utils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd6271-34ff-430e-acb1-385d25f7599b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cc3b9-8fb4-46b1-a99c-c6039859e536]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ba565-4b6c-4ccf-91d8-8a4742cb85a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04b13a3-297c-4eef-9caf-15454979ad5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:44:36 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c36f4-0d00-44bb-a298-5d36093a2917]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG os_brick.utils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating existing volume attachment record: 080ae0c8-8c8f-4052-a13f-480de3e8617c {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "b9927f87-7338-4b59-a675-d122ff035659" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:36 user nova-compute[75703]: INFO nova.compute.manager [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Attaching volume 7c32fc4a-9b3c-45db-8966-1279f450126f to /dev/vdb
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:36 user nova-compute[75703]: INFO nova.compute.manager [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Attaching volume d2511149-7eb3-4e70-bc48-e8f437b7200f to /dev/sdc
Nov 10 14:44:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:44:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:44:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:44:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:44:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:44:58 user nova-compute[75703]: INFO nova.compute.claims [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Claim successful on node user
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:44:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:44:59 user nova-compute[75703]: INFO nova.virt.block_device [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Booting with blank volume at /dev/vda
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG nova.policy [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90957e8164224a1285c067f0313178a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19b6b93f7b4e6dbe0ded4d084792f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:44:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Successfully created port: 4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Successfully updated port: 4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-changed-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Refreshing instance network info cache due to event network-changed-4a7cd975-41b4-4c54-a814-a852835e2e5f. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Refreshing network info cache for port 4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f09564cc-358a-4d35-b24d-fbfdba353206 req-e3157a5c-ad32-4f90-b9d7-239d06040501 service nova] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance network_info: |[{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:45:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7534MB free_disk=25.308597564697266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance aa81a0b3-cdb2-4618-97a7-743785e6c5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d4465989-c669-4edd-b7d2-f71e203b7142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2d61611e-951c-4789-87b4-44221eff8be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b9927f87-7338-4b59-a675-d122ff035659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5632da56-485f-4f52-8d59-59d908660a8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 571c71fd-4b7b-40b5-a728-be8b30580da5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:45:02 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:45:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:45:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG os_brick.utils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fdc86-2cd4-4155-81fd-9e4090fc0ca7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4693a2cd-9c22-4903-839c-b96ae3aa9428]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3fb387-3bea-4359-85d0-aa3b9a7a66c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1cb7cd-75cc-4809-87cc-4b361a5c4fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:45:12 user nova-compute[75703]: INFO nova.virt.block_device [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Booting with volume ab0b5918-c0dd-47cc-ad64-c8ff5457a009 at /dev/vdc
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.utils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:12 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee59ac4-59b4-4a57-a4b9-6aad97f816d8]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.utils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updating existing volume attachment record: 571be9d4-d19d-4ca8-aa7f-9136006ac25f {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[394b788c-3ebf-48ea-ac34-f215e8cf7856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dfa42e-f031-4bb1-8298-259263fbc433]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca02bda9-1a7b-4a26-bb02-0c8e2bbbb7a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e7a62b-abf6-4c17-b621-a54b85996788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:12 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f60b94-2e31-49ad-993c-02910e6d726c]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG os_brick.utils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updating existing volume attachment record: 6c3e7c20-2759-4d6e-83d6-3b82f061b6ce {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:12 user nova-compute[75703]: INFO nova.compute.manager [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Terminating instance
Nov 10 14:45:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-9bac37a4-b1dc-4bf5-8a04-2027a91f41e5 req-548a3816-51c5-409d-9bdc-219646dbc66b service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-vif-unplugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9bac37a4-b1dc-4bf5-8a04-2027a91f41e5 req-548a3816-51c5-409d-9bdc-219646dbc66b service nova] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9bac37a4-b1dc-4bf5-8a04-2027a91f41e5 req-548a3816-51c5-409d-9bdc-219646dbc66b service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9bac37a4-b1dc-4bf5-8a04-2027a91f41e5 req-548a3816-51c5-409d-9bdc-219646dbc66b service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-9bac37a4-b1dc-4bf5-8a04-2027a91f41e5 req-548a3816-51c5-409d-9bdc-219646dbc66b service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] No waiting events found dispatching network-vif-unplugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-9bac37a4-b1dc-4bf5-8a04-2027a91f41e5 req-548a3816-51c5-409d-9bdc-219646dbc66b service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-vif-unplugged-92e0a985-ea49-43cd-8b65-bfe38643de86 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:45:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Instance destroyed successfully.
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.objects.instance [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lazy-loading 'resources' on Instance uuid aa81a0b3-cdb2-4618-97a7-743785e6c5bb {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1929656186',display_name='tempest-DeleteServersTestJSON-server-1929656186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1929656186',id=2,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a280413e809f4f128f99529ea919692d',ramdisk_id='',reservation_id='r-8wh56xfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-20255733',owner_user_name='tempest-DeleteServersTestJSON-20255733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:42:11Z,user_data=None,user_id='28a7ce6177324febb76e7345d5f806d9',uuid=aa81a0b3-cdb2-4618-97a7-743785e6c5bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Converting VIF {"id": "92e0a985-ea49-43cd-8b65-bfe38643de86", "address": "fa:16:3e:49:7f:7a", "network": {"id": "734b7fbc-0e96-40c8-8f14-8d2e238a1711", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126163150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a280413e809f4f128f99529ea919692d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e0a985-ea", "ovs_interfaceid": "92e0a985-ea49-43cd-8b65-bfe38643de86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_vif [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92e0a985-ea, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4f734aa-2b31-4792-b783-9dc0db7f7edf) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:13 user nova-compute[75703]: INFO os_vif [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:7f:7a,bridge_name='br-int',has_traffic_filtering=True,id=92e0a985-ea49-43cd-8b65-bfe38643de86,network=Network(734b7fbc-0e96-40c8-8f14-8d2e238a1711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e0a985-ea')
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkgGAmWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:13 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db3a7b8-197a-4f83-b968-aeec1843bc40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:45:13 user nova-compute[75703]: No targets found.
Nov 10 14:45:13 user nova-compute[75703]: iSNS:
Nov 10 14:45:13 user nova-compute[75703]: No targets found.
Nov 10 14:45:13 user nova-compute[75703]: STATIC:
Nov 10 14:45:13 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96
Nov 10 14:45:13 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:45:13 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:45:13 user nova-compute[75703]: FIRMWARE:
Nov 10 14:45:13 user nova-compute[75703]: No targets found.
Nov 10 14:45:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:45:13 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:45:13 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7555d1e9-63f5-464d-82d8-66e2210d6d7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d91e01-4595-420b-b530-fdeb7fa99f16]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 (non-flash)
Nov 10 14:45:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 (non-flash)
Nov 10 14:45:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4742dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[83046755-6dee-4788-ab8f-1bdbfc1ed48e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb16e5b-d83b-42b8-a2a1-2a964d965861]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51bd2a0-4fd1-4898-b02a-6ab8c72e2afe]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc53897-daa1-4f37-9cbe-e47fb18c3916]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19316f7b-355b-4ee0-83cd-9c3324e65fdf]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f86f3fb-2d7a-4c8e-b7e5-80ba679644c2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260]
Nov 10 14:45:13 user nova-compute[75703]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96, portal: 172.16.0.220,3260] successful.
Nov 10 14:45:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ad7486-dcda-4294-bc78-c0b483f67b96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383d6d4-4e1f-4e11-8372-a8e33ce3ee69]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] <== disconnect_volume: return (308ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:45:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Deleting instance files /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb_del
Nov 10 14:45:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Deletion of /opt/stack/data/nova/instances/aa81a0b3-cdb2-4618-97a7-743785e6c5bb_del complete
Nov 10 14:45:13 user nova-compute[75703]: INFO nova.compute.manager [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 10 14:45:13 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:45:13 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:45:14 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:45:14 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Took 0.60 seconds to deallocate network for instance.
Nov 10 14:45:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-7702fe62-7055-42ac-9792-8e4db53e1fc3 req-c52b7552-a7fe-4512-92af-67a268c7fe39 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-vif-deleted-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-167d3919-9bbf-47a0-9858-e0e5ceaf7016 req-285da795-dbaa-4cc7-ab4e-8fa52a92f786 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received event network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-167d3919-9bbf-47a0-9858-e0e5ceaf7016 req-285da795-dbaa-4cc7-ab4e-8fa52a92f786 service nova] Acquiring lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-167d3919-9bbf-47a0-9858-e0e5ceaf7016 req-285da795-dbaa-4cc7-ab4e-8fa52a92f786 service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-167d3919-9bbf-47a0-9858-e0e5ceaf7016 req-285da795-dbaa-4cc7-ab4e-8fa52a92f786 service nova] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-167d3919-9bbf-47a0-9858-e0e5ceaf7016 req-285da795-dbaa-4cc7-ab4e-8fa52a92f786 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] No waiting events found dispatching network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:14 user nova-compute[75703]: WARNING nova.compute.manager [req-167d3919-9bbf-47a0-9858-e0e5ceaf7016 req-285da795-dbaa-4cc7-ab4e-8fa52a92f786 service nova] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Received unexpected event network-vif-plugged-92e0a985-ea49-43cd-8b65-bfe38643de86 for instance with vm_state active and task_state deleting.
Nov 10 14:45:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuwYnGry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:15 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:15 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:15 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2639f87-6d67-45a4-97ba-b9cf109b3e0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:45:15 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.utils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1078f727-b955-4f87-b3f1-525561c8b623]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612] added
Nov 10 14:45:15 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d92afa-48cc-4f4c-a9f1-aa857402ae2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhVvxTWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:15 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c111e-4cbb-4000-a954-f73e7903d968]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661c20c-db0f-4d68-895e-9cc284422fe8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd18dd26-3e58-4896-ba68-e1b11ea8c89c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9d288-de49-4460-9b32-5e0d6a5c2256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1b0c9-2f1c-4733-a668-67dd759f2624]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iuwYnGry {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:15 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46709df-6714-46b5-8936-3974e4a6709d]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.utils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating existing volume attachment record: b5eb16d2-3bb2-4d8b-94de-d5089d5ad0d6 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iuwYnGry" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd1458-5d83-4d84-8543-6e77bcd01f83]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iuwYnGry'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff572ad8-eb1b-493c-99a1-6d0adc449b26]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a0a413-079e-4b22-9f7a-cfc4f20a6548]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 14:45:15 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 14:45:15 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:15 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 14:45:15 user nova-compute[75703]: 
Nov 10 14:45:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78af3e0-c65e-4a46-9c05-ebae475ce557]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260]
Nov 10 14:45:16 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260] successful.
Nov 10 14:45:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc390f83-60e9-4ccc-827f-68e5a1121a42]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1879f8-fc82-4569-b357-16f75477f784]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ca0fa-95a2-4bfa-8550-66fe6c2d9930]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:16 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuwYnGry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26261313431356431', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261313431356431', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.301s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:17 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:17 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG nova.objects.instance [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lazy-loading 'flavor' on Instance uuid edc4e407-e824-4ee7-831b-fe0bf2ac4293 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e655a7b-5687-4df0-a5d1-2ac7b99ed35e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:45:17 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:45:17 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:45:17 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:45:17 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:45:17 user nova-compute[75703]:   <serial>5f509b52-467a-4e64-888d-b79c8a9d1612</serial>
Nov 10 14:45:17 user nova-compute[75703]: </disk>
Nov 10 14:45:17 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[891fb034-2dce-47f3-b9ae-76a8ffee6175]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f] added
Nov 10 14:45:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d86481-2c60-44f9-85f7-a8c7078a0561]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f8cc0-b11d-400c-9975-0f1d841a4a8e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhVvxTWS {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GhVvxTWS" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa460eb-0d26-4824-8ecb-d84c0724181d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GhVvxTWS'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df626c-7711-49fe-a0cf-f079ac7b0978]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49509a8-b378-42cb-845c-4aa3c16f83c9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ddb261-be5f-45a1-8d29-d267f852f41c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260]
Nov 10 14:45:17 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260] successful.
Nov 10 14:45:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69bf0c7-0f69-4276-a55d-565c83beb59a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8bfb4-4273-4cb3-b666-89db8a952466]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:17 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:17 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6044fd0-1ad9-4095-90ce-56d727bf8ef3]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhVvxTWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] No VIF found with MAC fa:16:3e:d4:04:9b, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] <== connect_volume: return (2655ms) {'type': 'block', 'scsi_wwn': '26334376136333234', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334376136333234', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG nova.objects.instance [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'flavor' on Instance uuid cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:45:18 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:45:18 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:45:18 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:45:18 user nova-compute[75703]:   <serial>342876fd-d96b-4d0c-a44f-5524e79ec40f</serial>
Nov 10 14:45:18 user nova-compute[75703]: </disk>
Nov 10 14:45:18 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No VIF found with MAC fa:16:3e:d4:39:ab, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:45:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:45:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 14:45:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:45:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:45:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSNqgscd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:37 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc8af91-4754-4cf2-a045-6655ea57091f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:45:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d997054-88fd-4b59-8386-d9158e654103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f] added
Nov 10 14:45:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af60355-ebea-44fc-af5a-b6b43c83c03a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[debea417-1f6b-428a-8b2d-21e6d2785070]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSNqgscd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSNqgscd" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7cb26-d20a-4047-bf10-86dc93a6dafc]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vSNqgscd'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba6fd2d-05ac-4dce-970d-9b4a6cdf1319]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd9ef5b-b700-4bb9-82ad-256b3b0a70b6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39fb07-e0b5-444c-9afe-7e711e8b0cea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260]
Nov 10 14:45:37 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260] successful.
Nov 10 14:45:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948d7c7-ca18-4c44-a5de-01dff1d8ad09]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e656971e-c08e-4be4-9771-2bda5a09510f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:37 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:45:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:37 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:45:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc4543-f400-492a-98cb-c49871b837cd]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSNqgscd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26264363162373933', 'path': '/dev/sdd'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264363162373933', 'path': '/dev/sdd'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lazy-loading 'flavor' on Instance uuid b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 14:45:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:45:38 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 14:45:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:45:38 user nova-compute[75703]:   <serial>7c32fc4a-9b3c-45db-8966-1279f450126f</serial>
Nov 10 14:45:38 user nova-compute[75703]: </disk>
Nov 10 14:45:38 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] No VIF found with MAC fa:16:3e:01:9b:a7, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:45:41 user nova-compute[75703]: INFO nova.compute.manager [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] [instance: aa81a0b3-cdb2-4618-97a7-743785e6c5bb] Took 27.11 seconds to detach 1 volumes for instance.
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geRavTMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:41 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:41 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:45:41 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:45:41 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463184a-5636-4703-a7ad-73eec77ac100]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:45:41 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[162cfe95-3b24-4b63-bc1a-9e20840c9675]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f] added
Nov 10 14:45:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58095c5-58a1-491c-aeeb-675857e9b170]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fbb5e451-a8d7-496d-b944-8460e4e17cd7 tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 75.265s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:41 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Deleted allocations for instance aa81a0b3-cdb2-4618-97a7-743785e6c5bb
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[64743b3e-9c5d-4234-86b1-adace8d4261d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geRavTMi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-211e9169-23c2-4a28-a958-1da96afb62b0 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 74.460s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geRavTMi" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[557fb76b-5707-4a57-b99d-739b730443ab]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geRavTMi'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e134947-fb70-474a-a314-136a07603425]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91bd90b-b3fd-449f-83f7-e92acecd44bd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-69b27b54-a08a-497b-b1b4-fd8850fbd022 tempest-DeleteServersTestJSON-20255733 tempest-DeleteServersTestJSON-20255733-project-member] Lock "aa81a0b3-cdb2-4618-97a7-743785e6c5bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 29.607s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0bf54e98-3b56-4a60-8813-179962f12344 tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "b9927f87-7338-4b59-a675-d122ff035659" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.772s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b397a87-1761-4b36-8fb0-5dc5fe2374d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260]
Nov 10 14:45:41 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260] successful.
Nov 10 14:45:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119a73a-0c64-4057-9f91-c3c8de79bd69]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491cbae-e218-48be-a6ee-f257dc3b5173]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:45:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:45:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9676de-bc25-4098-ad0e-199360536830]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geRavTMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.objects.instance [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'flavor' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.utils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6c81ab-13e7-4bac-982a-6bf96e9c03f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce34222-d710-485d-8fb1-6c0a0e430f15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0131e2b-4b4c-49af-8c5b-f6901525c339]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0bb93f-4aee-45b7-8072-9d0bc48967aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:42 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[785ab7d4-9a65-431e-891c-a34963c0a816]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.utils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating existing volume attachment record: 8b5e3d6a-8b69-4477-8717-4c9cabb2106f {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:42 user nova-compute[75703]: INFO nova.compute.manager [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Attaching volume b0e70bde-937c-4bb9-a1fc-0ca8e8936550 to /dev/vdb
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.utils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[787d5731-b1e3-4fc2-815c-4d6350056277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "5632da56-485f-4f52-8d59-59d908660a8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf1146f-b9f6-4025-93cf-6b75209b2850]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: INFO nova.compute.manager [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Terminating instance
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c70cce-a9ba-416f-bf39-ef67ae27212d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70e5541-668f-4b52-865b-f1561d4d9584]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:45:42 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f2141-0bf2-43ae-92f6-b6cdffcc8ea6]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG os_brick.utils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating existing volume attachment record: 009729c1-8cb7-4b48-af98-35e9440a9e29 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-73db71f6-f395-47d0-9271-c7b88322e39d req-ffba23b0-98bd-42f0-98c2-3c5e98b40d0e service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-unplugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-73db71f6-f395-47d0-9271-c7b88322e39d req-ffba23b0-98bd-42f0-98c2-3c5e98b40d0e service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-73db71f6-f395-47d0-9271-c7b88322e39d req-ffba23b0-98bd-42f0-98c2-3c5e98b40d0e service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-73db71f6-f395-47d0-9271-c7b88322e39d req-ffba23b0-98bd-42f0-98c2-3c5e98b40d0e service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-73db71f6-f395-47d0-9271-c7b88322e39d req-ffba23b0-98bd-42f0-98c2-3c5e98b40d0e service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-unplugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-73db71f6-f395-47d0-9271-c7b88322e39d req-ffba23b0-98bd-42f0-98c2-3c5e98b40d0e service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-unplugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26430616335316561', 'path': '/dev/sde'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430616335316561', 'path': '/dev/sde'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lazy-loading 'flavor' on Instance uuid 2d61611e-951c-4789-87b4-44221eff8be7 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:45:43 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:45:43 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 14:45:43 user nova-compute[75703]:   <target dev="sdc" bus="scsi"/>
Nov 10 14:45:43 user nova-compute[75703]:   <serial>d2511149-7eb3-4e70-bc48-e8f437b7200f</serial>
Nov 10 14:45:43 user nova-compute[75703]:   <address type="drive" controller="0" unit="2"/>
Nov 10 14:45:43 user nova-compute[75703]: </disk>
Nov 10 14:45:43 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Instance destroyed successfully.
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.objects.instance [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lazy-loading 'resources' on Instance uuid 5632da56-485f-4f52-8d59-59d908660a8f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-312782401',display_name='tempest-VolumesActionsTest-instance-312782401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-312782401',id=10,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:43:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8285dd3b302e414ab1af7fe6a452eca4',ramdisk_id='',reservation_id='r-5bawfbdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-482205440',owner_user_name='tempest-VolumesActionsTest-482205440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:43:37Z,user_data=None,user_id='ee49c0739fee4225b268b81a5a271abe',uuid=5632da56-485f-4f52-8d59-59d908660a8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converting VIF {"id": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "address": "fa:16:3e:8c:11:69", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d803d0c-9a", "ovs_interfaceid": "7d803d0c-9a80-4466-ac5e-0045ea19a988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG os_vif [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d803d0c-9a, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46fa2c2b-1f31-4ab3-947f-b338b3af3940) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: INFO os_vif [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:69,bridge_name='br-int',has_traffic_filtering=True,id=7d803d0c-9a80-4466-ac5e-0045ea19a988,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d803d0c-9a')
Nov 10 14:45:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Deleting instance files /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f_del
Nov 10 14:45:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Deletion of /opt/stack/data/nova/instances/5632da56-485f-4f52-8d59-59d908660a8f_del complete
Nov 10 14:45:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:43 user nova-compute[75703]: INFO nova.compute.manager [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 14:45:43 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No BDM found with device name sda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:45:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] No VIF found with MAC fa:16:3e:59:85:83, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:45:44 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Took 0.60 seconds to deallocate network for instance.
Nov 10 14:45:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-a9b112ac-ae45-42be-a6d5-8da436c4dd33 req-c3c9083a-2f55-43d8-9ca1-0b3cd1bc621f service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-deleted-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:45:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:44 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Deleted allocations for instance 5632da56-485f-4f52-8d59-59d908660a8f
Nov 10 14:45:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-92181bca-150f-4f0c-ba1d-7cb8af402e40 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "5632da56-485f-4f52-8d59-59d908660a8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:45 user nova-compute[75703]: WARNING nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state deleted and task_state None.
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:45 user nova-compute[75703]: WARNING nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state deleted and task_state None.
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:45 user nova-compute[75703]: WARNING nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state deleted and task_state None.
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-unplugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-unplugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:45 user nova-compute[75703]: WARNING nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-unplugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state deleted and task_state None.
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Acquiring lock "5632da56-485f-4f52-8d59-59d908660a8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] Lock "5632da56-485f-4f52-8d59-59d908660a8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] No waiting events found dispatching network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:45:45 user nova-compute[75703]: WARNING nova.compute.manager [req-e6b67104-fceb-48c4-9d3e-715af850da2f req-2c567a8c-3b1b-4c96-b346-d5c06221db78 service nova] [instance: 5632da56-485f-4f52-8d59-59d908660a8f] Received unexpected event network-vif-plugged-7d803d0c-9a80-4466-ac5e-0045ea19a988 for instance with vm_state deleted and task_state None.
Nov 10 14:45:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:45:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:45:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 14:45:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:45:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:45:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:45:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:46:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (sdc) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8091MB free_disk=25.361984252929688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d4465989-c669-4edd-b7d2-f71e203b7142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2d61611e-951c-4789-87b4-44221eff8be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b9927f87-7338-4b59-a675-d122ff035659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 571c71fd-4b7b-40b5-a728-be8b30580da5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:46:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:46:03 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:46:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:46:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:46:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f6d1d628-7f76-46c1-8a01-b8bdc418d5f2 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 86.998s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:46:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Creating image(s)
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Ensure instance console log exists: /opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Start _get_guest_xml network_info=[{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '30356a4d-7e14-4fb7-833f-33e04abe3122', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgmiSjkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '571c71fd-4b7b-40b5-a728-be8b30580da5', 'attached_at': '', 'detached_at': '', 'volume_id': 'db6a9681-ad81-4f01-b014-1462c614b6f4', 'serial': 'db6a9681-ad81-4f01-b014-1462c614b6f4'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '080ae0c8-8c8f-4052-a13f-480de3e8617c', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YATqxrfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '571c71fd-4b7b-40b5-a728-be8b30580da5', 'attached_at': '', 'detached_at': '', 'volume_id': 'be94a23c-71a0-4038-b3ab-e6cbc390a4f4', 'serial': 'be94a23c-71a0-4038-b3ab-e6cbc390a4f4'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'attachment_id': 'b5eb16d2-3bb2-4d8b-94de-d5089d5ad0d6', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoIVuXaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '571c71fd-4b7b-40b5-a728-be8b30580da5', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab0b5918-c0dd-47cc-ad64-c8ff5457a009', 'serial': 'ab0b5918-c0dd-47cc-ad64-c8ff5457a009'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:46:04 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:04 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgmiSjkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:04 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:04 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:04 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d704f7e9-38bf-4d09-a9c7-a2a2447cb21e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:46:04 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f322bd-0701-414c-8401-ae96ef6f0f1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4] added
Nov 10 14:46:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafdf764-828e-4263-81d8-015affaaf7e6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58aabf-2d0d-47a3-a363-9c820fb0fecd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tgmiSjkc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tgmiSjkc" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7910e4a-8d30-4346-9bc0-c5e58c1e2621]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tgmiSjkc'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe53b83-a08b-457b-8168-6600b7ff6514]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3189a8a-7bdd-4103-b0be-7c88d379c3e7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[90159422-a5bf-4331-867d-7680e5d22367]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260]
Nov 10 14:46:04 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f34771-15d3-4d0e-ad03-0aebe482e34f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] volume_snapshot_create: create_info: {'snapshot_id': '2ad8c37d-b371-4b80-8d58-4e15583d2383', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75703) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[65933dba-e8e8-4def-960c-8bb059fc1e3e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:04 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] snap xml: <domainsnapshot>
Nov 10 14:46:04 user nova-compute[75703]:   <disks>
Nov 10 14:46:04 user nova-compute[75703]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 10 14:46:04 user nova-compute[75703]:       <source file="/dev/new_file"/>
Nov 10 14:46:04 user nova-compute[75703]:     </disk>
Nov 10 14:46:04 user nova-compute[75703]:     <disk name="vda" snapshot="no"/>
Nov 10 14:46:04 user nova-compute[75703]:   </disks>
Nov 10 14:46:04 user nova-compute[75703]: </domainsnapshot>
Nov 10 14:46:04 user nova-compute[75703]:  {{(pid=75703) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.objects.instance [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] Lazy-loading 'system_metadata' on Instance uuid b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26801bc-8484-4a58-9db0-8b43e6da6c4a]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgmiSjkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] Traceback (most recent call last):
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     rv = execute(f, *args, **kwargs)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     six.reraise(c, e, tb)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     raise value
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     rv = meth(*args, **kwargs)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] 
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] Traceback (most recent call last):
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     self._volume_snapshot_create(context, instance, guest,
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     rv = execute(f, *args, **kwargs)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     six.reraise(c, e, tb)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     raise value
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     rv = meth(*args, **kwargs)
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] 
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG os_brick.utils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1b268-d760-46ed-992e-7ab0125f38da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d4188210-4c93-442b-9896-820915723d7e tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] volume_snapshot_delete: delete_info: {'volume_id': '7c32fc4a-9b3c-45db-8966-1279f450126f'} {{(pid=75703) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [None req-d4188210-4c93-442b-9896-820915723d7e tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] [instance: b9927f87-7338-4b59-a675-d122ff035659] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] Traceback (most recent call last):
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659]     if delete_info['type'] != 'qcow2':
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] KeyError: 'type'
Nov 10 14:46:04 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [instance: b9927f87-7338-4b59-a675-d122ff035659] 
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c853f9c-fd42-44ef-a69b-7d9634c236d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[91074ea5-2b67-47a5-90ec-30786c0aded5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[87916ad4-da10-4022-8390-5e13ef002c01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:05 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1789702-b4cb-48d0-b88c-ce703ca20b5d]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.utils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2ad8c37d-b371-4b80-8d58-4e15583d2383 could not be found.
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2ad8c37d-b371-4b80-8d58-4e15583d2383 could not be found. (HTTP 404) (Request-ID: req-40c31ba2-6567-43d4-939e-3d6c1a09824a)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2ad8c37d-b371-4b80-8d58-4e15583d2383 could not be found.
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server [None req-c9144ec0-eb02-4199-9d76-2e11c7f8a32d tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver [None req-d4188210-4c93-442b-9896-820915723d7e tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-424a45af-3aff-4753-a356-c14ebe8cd22a)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 14:46:05 user nova-compute[75703]: ERROR nova.virt.libvirt.driver 
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server [None req-d4188210-4c93-442b-9896-820915723d7e tempest-VolumesAssistedSnapshotsTest-523204788 tempest-VolumesAssistedSnapshotsTest-523204788-project] Exception during message handling: KeyError: 'type'
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 14:46:05 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:05 user nova-compute[75703]: INFO nova.compute.manager [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Detaching volume 342876fd-d96b-4d0c-a44f-5524e79ec40f
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26265663638666162', 'path': '/dev/sdf'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265663638666162', 'path': '/dev/sdf'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YATqxrfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:05 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:05 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:05 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c43df4-32f4-4d98-894c-07905d3f9f58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:46:05 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f70b8da-03b2-45ac-be13-7c7f09745993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4] added
Nov 10 14:46:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b76add8-a3d4-423f-9543-ef6fddc0a8b1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[868eeb32-0e6e-488d-ba7b-df5a5e29ea8f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YATqxrfJ {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YATqxrfJ" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[75561a5d-099d-4517-a41e-19289ffb1f6d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YATqxrfJ'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d8768-45d7-4169-809a-b3fe59797762]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:05 user nova-compute[75703]: INFO nova.compute.manager [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Swapping volume 5f509b52-467a-4e64-888d-b79c8a9d1612 for c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f404d56-bcc5-4918-986b-30ec0b27f019]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:05 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[651b89a1-23b1-4cf0-9ef3-e136fbcbf8e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260]
Nov 10 14:46:06 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:06 user nova-compute[75703]: INFO nova.compute.manager [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Detaching volume d2511149-7eb3-4e70-bc48-e8f437b7200f
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceba8444-720f-4602-a940-e6c93b952dcd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "b9927f87-7338-4b59-a675-d122ff035659" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb88d68-a57a-44f6-a095-2a8fb605a904]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:06 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:06 user nova-compute[75703]: INFO nova.compute.manager [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Detaching volume 7c32fc4a-9b3c-45db-8966-1279f450126f
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ce480-d4a0-4c83-8327-87079e043c90]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YATqxrfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "29e60285-ce7c-4b88-b013-458e19039808" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "29e60285-ce7c-4b88-b013-458e19039808" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:07 user nova-compute[75703]: INFO nova.compute.manager [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Unshelving
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26430636633636665', 'path': '/dev/sdg'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430636633636665', 'path': '/dev/sdg'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:07 user nova-compute[75703]: INFO nova.virt.block_device [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Booting with volume 8ce365b3-6972-4996-b7cf-bb2e82c1a819 at /dev/vdc
Nov 10 14:46:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoIVuXaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:07 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:07 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:07 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66eb8ac-7738-443f-bfb7-1f58ae911938]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:46:07 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf94aed-0752-4c90-bae1-fe8c28e3bb65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009] added
Nov 10 14:46:07 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[93224901-b3b8-4b23-89ba-32c337374c1a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bef6ae2-9dd7-45a1-8be9-2557de3f9e76]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoIVuXaK {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoIVuXaK" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6900419-b252-4572-939a-98db40b90649]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoIVuXaK'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53d23c-8e42-4ad5-9e83-cad33d364e33]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2560f806-5a74-4cbb-a5c4-1859d45e6d12]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcabb3a-140c-4de4-979c-b418a32865a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260]
Nov 10 14:46:07 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:07 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d2599c-c922-439e-9527-b00c37be67fa]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123e006-cf43-48aa-b125-2ed500f10b04]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:07 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d22ff-094a-44b4-a390-8c6383c2cef3]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoIVuXaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26363336664356436', 'path': '/dev/sdh'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363336664356436', 'path': '/dev/sdh'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lazy-loading 'pci_devices' on Instance uuid 571c71fd-4b7b-40b5-a728-be8b30580da5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:46:08 user nova-compute[75703]:   <uuid>571c71fd-4b7b-40b5-a728-be8b30580da5</uuid>
Nov 10 14:46:08 user nova-compute[75703]:   <name>instance-0000000b</name>
Nov 10 14:46:08 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:46:08 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:46:08 user nova-compute[75703]:   <metadata>
Nov 10 14:46:08 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:46:08 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:46:08 user nova-compute[75703]:       <nova:name>tempest-device-tagging-server-962779522</nova:name>
Nov 10 14:46:08 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:46:04</nova:creationTime>
Nov 10 14:46:08 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:46:08 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:46:08 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:46:08 user nova-compute[75703]:       <nova:owner>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:user uuid="d23035d70a214b86a7717fd3031e6a5a">tempest-TaggedBootDevicesTest-1616361045-project-member</nova:user>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:project uuid="f573a2d67c9949e2bae56d01a5ef5e49">tempest-TaggedBootDevicesTest-1616361045</nova:project>
Nov 10 14:46:08 user nova-compute[75703]:       </nova:owner>
Nov 10 14:46:08 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:46:08 user nova-compute[75703]:       <nova:ports>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="86926a35-7954-4ff2-8ff8-45f3252e9251">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="12fbc1f1-12f6-4821-8a08-dbb4c5c384c3">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="f8f4b90a-cf48-4bbe-bd55-868e5893ae04">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="e416f060-9c1e-4b38-8dd2-5999b8e1fd0b">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="376356e9-1d11-4a3b-a897-3f8442b1ba3c">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="6927009b-f303-4652-8a2c-7aa4ca693b8f">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:         <nova:port uuid="1cd61549-3867-4279-842a-38dbfa9669f8">
Nov 10 14:46:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 14:46:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:08 user nova-compute[75703]:       </nova:ports>
Nov 10 14:46:08 user nova-compute[75703]:     </nova:instance>
Nov 10 14:46:08 user nova-compute[75703]:   </metadata>
Nov 10 14:46:08 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:46:08 user nova-compute[75703]:     <system>
Nov 10 14:46:08 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:46:08 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:46:08 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:46:08 user nova-compute[75703]:       <entry name="serial">571c71fd-4b7b-40b5-a728-be8b30580da5</entry>
Nov 10 14:46:08 user nova-compute[75703]:       <entry name="uuid">571c71fd-4b7b-40b5-a728-be8b30580da5</entry>
Nov 10 14:46:08 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:46:08 user nova-compute[75703]:     </system>
Nov 10 14:46:08 user nova-compute[75703]:   </sysinfo>
Nov 10 14:46:08 user nova-compute[75703]:   <os>
Nov 10 14:46:08 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:46:08 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:46:08 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:46:08 user nova-compute[75703]:   </os>
Nov 10 14:46:08 user nova-compute[75703]:   <features>
Nov 10 14:46:08 user nova-compute[75703]:     <acpi/>
Nov 10 14:46:08 user nova-compute[75703]:     <apic/>
Nov 10 14:46:08 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:46:08 user nova-compute[75703]:   </features>
Nov 10 14:46:08 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:46:08 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:46:08 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:46:08 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:46:08 user nova-compute[75703]:   </clock>
Nov 10 14:46:08 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:46:08 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:46:08 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:46:08 user nova-compute[75703]:   </cpu>
Nov 10 14:46:08 user nova-compute[75703]:   <devices>
Nov 10 14:46:08 user nova-compute[75703]:     <disk type="file" device="cdrom">
Nov 10 14:46:08 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 14:46:08 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5/disk.config"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="hda" bus="ide"/>
Nov 10 14:46:08 user nova-compute[75703]:     </disk>
Nov 10 14:46:08 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:46:08 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:08 user nova-compute[75703]:       <source dev="/dev/sdf"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <serial>db6a9681-ad81-4f01-b014-1462c614b6f4</serial>
Nov 10 14:46:08 user nova-compute[75703]:     </disk>
Nov 10 14:46:08 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:46:08 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:08 user nova-compute[75703]:       <source dev="/dev/sdg"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <serial>be94a23c-71a0-4038-b3ab-e6cbc390a4f4</serial>
Nov 10 14:46:08 user nova-compute[75703]:     </disk>
Nov 10 14:46:08 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:46:08 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:08 user nova-compute[75703]:       <source dev="/dev/sdh"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="vdc" bus="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <serial>ab0b5918-c0dd-47cc-ad64-c8ff5457a009</serial>
Nov 10 14:46:08 user nova-compute[75703]:     </disk>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:50:4c:75"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tap86926a35-79"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:e9:26:87"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tap12fbc1f1-12"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:0a:16:e0"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tapf8f4b90a-cf"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:e3:54:66"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tape416f060-9c"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:96:02:bf"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tap376356e9-1d"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:66:69:91"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tap6927009b-f3"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:08 user nova-compute[75703]:       <mac address="fa:16:3e:e6:02:b5"/>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:08 user nova-compute[75703]:       <target dev="tap1cd61549-38"/>
Nov 10 14:46:08 user nova-compute[75703]:     </interface>
Nov 10 14:46:08 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:46:08 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5/console.log" append="off"/>
Nov 10 14:46:08 user nova-compute[75703]:     </serial>
Nov 10 14:46:08 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:46:08 user nova-compute[75703]:     <video>
Nov 10 14:46:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:08 user nova-compute[75703]:     </video>
Nov 10 14:46:08 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:46:08 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:46:08 user nova-compute[75703]:     </rng>
Nov 10 14:46:08 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:46:08 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:46:08 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:46:08 user nova-compute[75703]:     </memballoon>
Nov 10 14:46:08 user nova-compute[75703]:   </devices>
Nov 10 14:46:08 user nova-compute[75703]: </domain>
Nov 10 14:46:08 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bac34869-1406-55cc-a715-30889693455e', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86926a35-79, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86926a35-79, col_values=(('qos', UUID('a70a4d95-6376-4d53-beec-fdf18c1a46e6')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86926a35-79, col_values=(('external_ids', {'iface-id': '86926a35-7954-4ff2-8ff8-45f3252e9251', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:4c:75', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79')
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf347495-9d25-5d4c-a459-8c845765258b', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12fbc1f1-12, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12fbc1f1-12, col_values=(('qos', UUID('2a7c7aa5-cfae-4f21-b434-43ee5a9bd90d')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12fbc1f1-12, col_values=(('external_ids', {'iface-id': '12fbc1f1-12f6-4821-8a08-dbb4c5c384c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:26:87', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12')
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '782dd8a0-7e92-5a1d-ac55-d6f281ef06a3', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8f4b90a-cf, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8f4b90a-cf, col_values=(('qos', UUID('8a12db5d-b14e-43d6-9de9-5bf9fbe58e3f')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8f4b90a-cf, col_values=(('external_ids', {'iface-id': 'f8f4b90a-cf48-4bbe-bd55-868e5893ae04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:16:e0', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf')
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '769ca802-cfc2-50a4-8d24-9d134cff895a', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape416f060-9c, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape416f060-9c, col_values=(('qos', UUID('346cb368-9037-42d7-813a-86a6de28b107')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape416f060-9c, col_values=(('external_ids', {'iface-id': 'e416f060-9c1e-4b38-8dd2-5999b8e1fd0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:54:66', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c')
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d903c5a-881d-5ab8-ad74-dc1ce2958a50', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap376356e9-1d, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap376356e9-1d, col_values=(('qos', UUID('302806c4-a66c-4c05-856d-73d1b8b65e9a')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap376356e9-1d, col_values=(('external_ids', {'iface-id': '376356e9-1d11-4a3b-a897-3f8442b1ba3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:02:bf', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:08 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d')
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a5d5287-104c-5fee-ac50-50b1a258f199', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6927009b-f3, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6927009b-f3, col_values=(('qos', UUID('b31f3f91-27a2-4717-ba3b-891a5bcaf3c2')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6927009b-f3, col_values=(('external_ids', {'iface-id': '6927009b-f303-4652-8a2c-7aa4ca693b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:69:91', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3')
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f78870af-6deb-504d-bf6f-1fcbbaadc741', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cd61549-38, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cd61549-38, col_values=(('qos', UUID('4dddae33-7654-4b19-a548-390fc313a2c5')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cd61549-38, col_values=(('external_ids', {'iface-id': '1cd61549-3867-4279-842a-38dbfa9669f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:02:b5', 'vm-uuid': '571c71fd-4b7b-40b5-a728-be8b30580da5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:09 user nova-compute[75703]: INFO os_vif [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38')
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] No BDM found with device name hda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] No VIF found with MAC fa:16:3e:50:4c:75, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] No VIF found with MAC fa:16:3e:96:02:bf, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Using config drive
Nov 10 14:46:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Creating config drive at /opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5/disk.config
Nov 10 14:46:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuas1dhdx {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuas1dhdx" returned: 0 in 0.060s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-b1b3db43-79ef-4edb-9710-c6b6db0307a8 req-b43a7f99-da3d-4795-a0cf-cf8621d982b0 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b1b3db43-79ef-4edb-9710-c6b6db0307a8 req-b43a7f99-da3d-4795-a0cf-cf8621d982b0 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b1b3db43-79ef-4edb-9710-c6b6db0307a8 req-b43a7f99-da3d-4795-a0cf-cf8621d982b0 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b1b3db43-79ef-4edb-9710-c6b6db0307a8 req-b43a7f99-da3d-4795-a0cf-cf8621d982b0 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-b1b3db43-79ef-4edb-9710-c6b6db0307a8 req-b43a7f99-da3d-4795-a0cf-cf8621d982b0 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:11 user nova-compute[75703]: WARNING nova.compute.manager [req-b1b3db43-79ef-4edb-9710-c6b6db0307a8 req-b43a7f99-da3d-4795-a0cf-cf8621d982b0 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 for instance with vm_state building and task_state spawning.
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-b506d1e0-7801-480f-a388-3dc09700e5dd req-16c030ac-3d35-44ba-960a-866804cc8111 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b506d1e0-7801-480f-a388-3dc09700e5dd req-16c030ac-3d35-44ba-960a-866804cc8111 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b506d1e0-7801-480f-a388-3dc09700e5dd req-16c030ac-3d35-44ba-960a-866804cc8111 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b506d1e0-7801-480f-a388-3dc09700e5dd req-16c030ac-3d35-44ba-960a-866804cc8111 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-b506d1e0-7801-480f-a388-3dc09700e5dd req-16c030ac-3d35-44ba-960a-866804cc8111 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:11 user nova-compute[75703]: WARNING nova.compute.manager [req-b506d1e0-7801-480f-a388-3dc09700e5dd req-16c030ac-3d35-44ba-960a-866804cc8111 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 for instance with vm_state building and task_state spawning.
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-6989a0c9-7cd9-4742-9349-f3d3e2d5cb51 req-afb7c2f1-8876-4f07-8f27-985c847d31eb service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6989a0c9-7cd9-4742-9349-f3d3e2d5cb51 req-afb7c2f1-8876-4f07-8f27-985c847d31eb service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6989a0c9-7cd9-4742-9349-f3d3e2d5cb51 req-afb7c2f1-8876-4f07-8f27-985c847d31eb service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6989a0c9-7cd9-4742-9349-f3d3e2d5cb51 req-afb7c2f1-8876-4f07-8f27-985c847d31eb service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-6989a0c9-7cd9-4742-9349-f3d3e2d5cb51 req-afb7c2f1-8876-4f07-8f27-985c847d31eb service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:12 user nova-compute[75703]: WARNING nova.compute.manager [req-6989a0c9-7cd9-4742-9349-f3d3e2d5cb51 req-afb7c2f1-8876-4f07-8f27-985c847d31eb service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c for instance with vm_state building and task_state spawning.
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-836bb3fc-d380-4bca-8a10-f6d287febc2d req-f2bb5994-2cb5-417a-8089-e277efe56715 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f for instance with vm_state building and task_state spawning.
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:13 user nova-compute[75703]: WARNING nova.compute.manager [req-a8cfe1b2-8258-4c1e-8308-c2f16cd8aa97 req-5bb1007a-f38d-4ad1-88db-1e475f6aabda service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f for instance with vm_state building and task_state spawning.
Nov 10 14:46:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-b3c4af55-b388-45e1-bc1e-180cd2fdea48 req-1b3bb662-dcdb-43d0-9f1d-fdd2392447ef service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b3c4af55-b388-45e1-bc1e-180cd2fdea48 req-1b3bb662-dcdb-43d0-9f1d-fdd2392447ef service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b3c4af55-b388-45e1-bc1e-180cd2fdea48 req-1b3bb662-dcdb-43d0-9f1d-fdd2392447ef service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b3c4af55-b388-45e1-bc1e-180cd2fdea48 req-1b3bb662-dcdb-43d0-9f1d-fdd2392447ef service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-b3c4af55-b388-45e1-bc1e-180cd2fdea48 req-1b3bb662-dcdb-43d0-9f1d-fdd2392447ef service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:14 user nova-compute[75703]: WARNING nova.compute.manager [req-b3c4af55-b388-45e1-bc1e-180cd2fdea48 req-1b3bb662-dcdb-43d0-9f1d-fdd2392447ef service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c for instance with vm_state building and task_state spawning.
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:46:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance spawned successfully.
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-74728965-e73f-4ec5-b244-3818b394f3b7 req-adaf11fc-51d5-46b4-b154-810921995fba service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74728965-e73f-4ec5-b244-3818b394f3b7 req-adaf11fc-51d5-46b4-b154-810921995fba service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74728965-e73f-4ec5-b244-3818b394f3b7 req-adaf11fc-51d5-46b4-b154-810921995fba service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74728965-e73f-4ec5-b244-3818b394f3b7 req-adaf11fc-51d5-46b4-b154-810921995fba service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-74728965-e73f-4ec5-b244-3818b394f3b7 req-adaf11fc-51d5-46b4-b154-810921995fba service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:15 user nova-compute[75703]: WARNING nova.compute.manager [req-74728965-e73f-4ec5-b244-3818b394f3b7 req-adaf11fc-51d5-46b4-b154-810921995fba service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 for instance with vm_state building and task_state spawning.
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:15 user nova-compute[75703]: INFO nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Took 11.46 seconds to spawn the instance on the hypervisor.
Nov 10 14:46:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:46:15 user nova-compute[75703]: INFO nova.compute.manager [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Took 130.61 seconds to build instance.
Nov 10 14:46:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6912f715-816c-412b-9d7c-35e5b2cb9947 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 130.747s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 14:46:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:46:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:46:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:34 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:46:34 user nova-compute[75703]: INFO nova.compute.claims [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Claim successful on node user
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:46:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.policy [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee49c0739fee4225b268b81a5a271abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8285dd3b302e414ab1af7fe6a452eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:46:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Creating image(s)
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "/opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "/opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk 1073741824" returned: 0 in 0.048s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.169s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Successfully created port: b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Cannot resize image /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Ensure instance console log exists: /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Successfully updated port: b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "refresh_cache-9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquired lock "refresh_cache-9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-changed-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Refreshing instance network info cache due to event network-changed-b8ea0876-0de2-4278-9d84-80641b1d90f5. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] Acquiring lock "refresh_cache-9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:46:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Updating instance_info_cache with network_info: [{"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Releasing lock "refresh_cache-9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Instance network_info: |[{"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] Acquired lock "refresh_cache-9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Refreshing network info cache for port b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Start _get_guest_xml network_info=[{"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:46:37 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:37 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-864290804',display_name='tempest-VolumesActionsTest-instance-864290804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-864290804',id=13,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8285dd3b302e414ab1af7fe6a452eca4',ramdisk_id='',reservation_id='r-f4tlqad4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-482205440',owner_user_name='tempest-VolumesActionsTest-482205440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:46:35Z,user_data=None,user_id='ee49c0739fee4225b268b81a5a271abe',uuid=9b6d99b3-5d01-42f2-93ec-dc4398d30c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converting VIF {"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:46:37 user nova-compute[75703]:   <uuid>9b6d99b3-5d01-42f2-93ec-dc4398d30c3a</uuid>
Nov 10 14:46:37 user nova-compute[75703]:   <name>instance-0000000d</name>
Nov 10 14:46:37 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:46:37 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:46:37 user nova-compute[75703]:   <metadata>
Nov 10 14:46:37 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:46:37 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:46:37 user nova-compute[75703]:       <nova:name>tempest-VolumesActionsTest-instance-864290804</nova:name>
Nov 10 14:46:37 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:46:37</nova:creationTime>
Nov 10 14:46:37 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:46:37 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:46:37 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:46:37 user nova-compute[75703]:       <nova:owner>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:user uuid="ee49c0739fee4225b268b81a5a271abe">tempest-VolumesActionsTest-482205440-project-member</nova:user>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:project uuid="8285dd3b302e414ab1af7fe6a452eca4">tempest-VolumesActionsTest-482205440</nova:project>
Nov 10 14:46:37 user nova-compute[75703]:       </nova:owner>
Nov 10 14:46:37 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:46:37 user nova-compute[75703]:       <nova:ports>
Nov 10 14:46:37 user nova-compute[75703]:         <nova:port uuid="b8ea0876-0de2-4278-9d84-80641b1d90f5">
Nov 10 14:46:37 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:46:37 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:37 user nova-compute[75703]:       </nova:ports>
Nov 10 14:46:37 user nova-compute[75703]:     </nova:instance>
Nov 10 14:46:37 user nova-compute[75703]:   </metadata>
Nov 10 14:46:37 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:46:37 user nova-compute[75703]:     <system>
Nov 10 14:46:37 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:46:37 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:46:37 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:46:37 user nova-compute[75703]:       <entry name="serial">9b6d99b3-5d01-42f2-93ec-dc4398d30c3a</entry>
Nov 10 14:46:37 user nova-compute[75703]:       <entry name="uuid">9b6d99b3-5d01-42f2-93ec-dc4398d30c3a</entry>
Nov 10 14:46:37 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:46:37 user nova-compute[75703]:     </system>
Nov 10 14:46:37 user nova-compute[75703]:   </sysinfo>
Nov 10 14:46:37 user nova-compute[75703]:   <os>
Nov 10 14:46:37 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:46:37 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:46:37 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:46:37 user nova-compute[75703]:   </os>
Nov 10 14:46:37 user nova-compute[75703]:   <features>
Nov 10 14:46:37 user nova-compute[75703]:     <acpi/>
Nov 10 14:46:37 user nova-compute[75703]:     <apic/>
Nov 10 14:46:37 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:46:37 user nova-compute[75703]:   </features>
Nov 10 14:46:37 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:46:37 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:46:37 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:46:37 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:46:37 user nova-compute[75703]:   </clock>
Nov 10 14:46:37 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:46:37 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:46:37 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:46:37 user nova-compute[75703]:   </cpu>
Nov 10 14:46:37 user nova-compute[75703]:   <devices>
Nov 10 14:46:37 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:46:37 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:46:37 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk"/>
Nov 10 14:46:37 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:46:37 user nova-compute[75703]:     </disk>
Nov 10 14:46:37 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:37 user nova-compute[75703]:       <mac address="fa:16:3e:06:9e:a5"/>
Nov 10 14:46:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:37 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:37 user nova-compute[75703]:       <target dev="tapb8ea0876-0d"/>
Nov 10 14:46:37 user nova-compute[75703]:     </interface>
Nov 10 14:46:37 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:46:37 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/console.log" append="off"/>
Nov 10 14:46:37 user nova-compute[75703]:     </serial>
Nov 10 14:46:37 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:46:37 user nova-compute[75703]:     <video>
Nov 10 14:46:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:37 user nova-compute[75703]:     </video>
Nov 10 14:46:37 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:46:37 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:46:37 user nova-compute[75703]:     </rng>
Nov 10 14:46:37 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:46:37 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:46:37 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:46:37 user nova-compute[75703]:     </memballoon>
Nov 10 14:46:37 user nova-compute[75703]:   </devices>
Nov 10 14:46:37 user nova-compute[75703]: </domain>
Nov 10 14:46:37 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-864290804',display_name='tempest-VolumesActionsTest-instance-864290804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-864290804',id=13,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8285dd3b302e414ab1af7fe6a452eca4',ramdisk_id='',reservation_id='r-f4tlqad4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-482205440',owner_user_name='tempest-VolumesActionsTest-482205440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:46:35Z,user_data=None,user_id='ee49c0739fee4225b268b81a5a271abe',uuid=9b6d99b3-5d01-42f2-93ec-dc4398d30c3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converting VIF {"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_vif [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d95eca7-ceb7-5170-84ca-8ce67656cc7a', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8ea0876-0d, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8ea0876-0d, col_values=(('qos', UUID('7bf5b81a-5413-464b-bee5-502eeaaa8155')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8ea0876-0d, col_values=(('external_ids', {'iface-id': 'b8ea0876-0de2-4278-9d84-80641b1d90f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:9e:a5', 'vm-uuid': '9b6d99b3-5d01-42f2-93ec-dc4398d30c3a'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:37 user nova-compute[75703]: INFO os_vif [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d')
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] No VIF found with MAC fa:16:3e:06:9e:a5, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjYhuep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edc4e407-e824-4ee7-831b-fe0bf2ac4293', 'attached_at': '', 'detached_at': '', 'volume_id': 'c59a491b-173c-430b-9e3f-7d9af9f95962', 'serial': 'c59a491b-173c-430b-9e3f-7d9af9f95962'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuwYnGry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'edc4e407-e824-4ee7-831b-fe0bf2ac4293', 'attached_at': '', 'detached_at': '', 'volume_id': '5f509b52-467a-4e64-888d-b79c8a9d1612', 'serial'} {{(pid=75703) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjYhuep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:37 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: INFO nova.virt.block_device [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Attempting to driver detach volume 342876fd-d96b-4d0c-a44f-5524e79ec40f from mountpoint /dev/vdb
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8016261b-f9ae-49ad-8636-de4ae18062b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:46:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Updated VIF entry in instance network info cache for port b8ea0876-0de2-4278-9d84-80641b1d90f5. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Updating instance_info_cache with network_info: [{"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde09c68-3420-46c4-b62c-46ec53cdd763]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962] added
Nov 10 14:46:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ca4215ab-6a65-40c5-955a-36061751a5e3 req-acc9a529-d6ec-427b-b008-52a3cc5055f0 service nova] Releasing lock "refresh_cache-9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Attempting to detach device vdb from instance cc2a6989-8214-499a-b2d4-b8c88225a992 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:46:37 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:37 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:46:37 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:46:37 user nova-compute[75703]:   <serial>342876fd-d96b-4d0c-a44f-5524e79ec40f</serial>
Nov 10 14:46:37 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:46:37 user nova-compute[75703]: </disk>
Nov 10 14:46:37 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:46:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Successfully detached device vdb from instance cc2a6989-8214-499a-b2d4-b8c88225a992 from the persistent domain config.
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc2a6989-8214-499a-b2d4-b8c88225a992 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:46:37 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:37 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:46:37 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:46:37 user nova-compute[75703]:   <serial>342876fd-d96b-4d0c-a44f-5524e79ec40f</serial>
Nov 10 14:46:37 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:46:37 user nova-compute[75703]: </disk>
Nov 10 14:46:37 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c36b56c-033f-4f38-a7a0-e72ba7bec1bd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ddc5ff-6a41-4b20-93cd-e0d9da9b9a17]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMjYhuep {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMjYhuep" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45db25-0963-4905-8771-bbb7b869208c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bMjYhuep'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dad543a-e932-48d9-8cfd-7d1131302e6f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ce811c-8b04-4cd0-a236-21d8c161fdec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1833b2-b41d-467b-8f26-bf7358434745]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260]
Nov 10 14:46:37 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfb1d26-5fe0-4b11-83e8-da9fa631d624]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3266d4-8533-4ffa-8edb-dbfd8b212d93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: INFO nova.virt.block_device [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Attempting to driver detach volume d2511149-7eb3-4e70-bc48-e8f437b7200f from mountpoint /dev/sdc
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Attempting to detach device sdc from instance 2d61611e-951c-4789-87b4-44221eff8be7 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:46:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:38 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 14:46:38 user nova-compute[75703]:   <target dev="sdc" bus="scsi"/>
Nov 10 14:46:38 user nova-compute[75703]:   <serial>d2511149-7eb3-4e70-bc48-e8f437b7200f</serial>
Nov 10 14:46:38 user nova-compute[75703]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 14:46:38 user nova-compute[75703]: </disk>
Nov 10 14:46:38 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40a3455-d06f-4548-b295-d2176be36686]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjYhuep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Successfully detached device sdc from instance 2d61611e-951c-4789-87b4-44221eff8be7 from the persistent domain config.
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2d61611e-951c-4789-87b4-44221eff8be7 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:46:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:38 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 14:46:38 user nova-compute[75703]:   <target dev="sdc" bus="scsi"/>
Nov 10 14:46:38 user nova-compute[75703]:   <serial>d2511149-7eb3-4e70-bc48-e8f437b7200f</serial>
Nov 10 14:46:38 user nova-compute[75703]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 14:46:38 user nova-compute[75703]: </disk>
Nov 10 14:46:38 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:46:38 user nova-compute[75703]: INFO nova.virt.block_device [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Attempting to driver detach volume 7c32fc4a-9b3c-45db-8966-1279f450126f from mountpoint /dev/vdb
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Attempting to detach device vdb from instance b9927f87-7338-4b59-a675-d122ff035659 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 14:46:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:38 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 14:46:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:46:38 user nova-compute[75703]:   <serial>7c32fc4a-9b3c-45db-8966-1279f450126f</serial>
Nov 10 14:46:38 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:46:38 user nova-compute[75703]: </disk>
Nov 10 14:46:38 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:46:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Successfully detached device vdb from instance b9927f87-7338-4b59-a675-d122ff035659 from the persistent domain config.
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9927f87-7338-4b59-a675-d122ff035659 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 14:46:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:38 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 14:46:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:46:38 user nova-compute[75703]:   <serial>7c32fc4a-9b3c-45db-8966-1279f450126f</serial>
Nov 10 14:46:38 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:46:38 user nova-compute[75703]: </disk>
Nov 10 14:46:38 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.utils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c9970-1554-4704-a719-d44efc1334c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d6a49-9dcb-4490-95cf-aa887fa031da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[57682386-c180-41d4-b39d-59010fdf1be4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a94b2d6-24c3-4995-9430-c6765bc977b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:38 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7da18-9862-4729-a451-1b4810a38aab]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.utils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Updating existing volume attachment record: a9264c33-39b2-4c82-b256-bd2d64b293cf {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mazkwPgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:38 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:46:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Creating image(s)
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Ensure instance console log exists: /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Start _get_guest_xml network_info=[{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '8b5e3d6a-8b69-4477-8717-4c9cabb2106f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15', 'attached_at': '', 'detached_at': '', 'volume_id': '20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'serial': '20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:46:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:38 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lazy-loading 'flavor' on Instance uuid d4465989-c669-4edd-b7d2-f71e203b7142 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2d61611e-951c-4789-87b4-44221eff8be7 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:38 user nova-compute[75703]: INFO nova.compute.manager [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Attaching volume 90f9c0ae-b616-49cc-8f44-7e3ef7aff150 to /dev/vdb
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.utils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a46ad7-9456-4c7f-b828-3a87adb1ad48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0c368-56e0-48d7-8b48-4df2fa1f3034]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8ffa48-0285-4a87-a576-bad309f1a410]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dfa09e-44ec-4d2e-a159-1b01dcfb285f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:38 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:46:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b244b66-c872-4baf-b93a-af72f47a0095]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG os_brick.utils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:38 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating existing volume attachment record: 539e4aa3-2986-443e-a269-68e29e8439a7 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23863613433623334', 'path': '/dev/sdi'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863613433623334', 'path': '/dev/sdi'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.687s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:39 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:39 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lazy-loading 'flavor' on Instance uuid edc4e407-e824-4ee7-831b-fe0bf2ac4293 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf16509-880b-4e81-ba26-1aa495d19ec6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:46:39 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17014f-1254-441f-8d98-b7377ef689d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550] added
Nov 10 14:46:39 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be1526-4196-4771-9732-cc88d1909ddf]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c83b8f-e51a-43c2-a755-82e762977a23]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mazkwPgd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mazkwPgd" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3184c6-865c-479d-adf1-6000d923e820]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mazkwPgd'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa93821f-b2ed-4e20-8437-91b6c1322c8c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4f886a-b05f-4060-bf8b-eb103074321b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6429b-fbec-4fb1-8125-e8f753c430c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260]
Nov 10 14:46:39 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:39 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf23964-59f0-44d9-878e-2c5b6cdffafd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3815d7d-1f86-4ea7-abba-57bfbebc7104]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:39 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9008548-3541-4d84-8efd-1de70b8923b9]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mazkwPgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 13631488 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-33828ddf-7e46-4f91-a56a-0d06b2d3c981 req-5ac7be58-8a2e-475c-bcf7-5edbe879306d service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-33828ddf-7e46-4f91-a56a-0d06b2d3c981 req-5ac7be58-8a2e-475c-bcf7-5edbe879306d service nova] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-33828ddf-7e46-4f91-a56a-0d06b2d3c981 req-5ac7be58-8a2e-475c-bcf7-5edbe879306d service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-33828ddf-7e46-4f91-a56a-0d06b2d3c981 req-5ac7be58-8a2e-475c-bcf7-5edbe879306d service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-33828ddf-7e46-4f91-a56a-0d06b2d3c981 req-5ac7be58-8a2e-475c-bcf7-5edbe879306d service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] No waiting events found dispatching network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:40 user nova-compute[75703]: WARNING nova.compute.manager [req-33828ddf-7e46-4f91-a56a-0d06b2d3c981 req-5ac7be58-8a2e-475c-bcf7-5edbe879306d service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received unexpected event network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 for instance with vm_state building and task_state spawning.
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] <== connect_volume: return (2080ms) {'type': 'block', 'scsi_wwn': '26639663361393166', 'path': '/dev/sdj'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639663361393166', 'path': '/dev/sdj'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.961s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:40 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:40 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.objects.instance [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'flavor' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07dd8a0-2789-4574-b0b8-1f41f073d8f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:46:40 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:46:40 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:40 user nova-compute[75703]:   <source dev="/dev/sdj"/>
Nov 10 14:46:40 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:46:40 user nova-compute[75703]:   <serial>b0e70bde-937c-4bb9-a1fc-0ca8e8936550</serial>
Nov 10 14:46:40 user nova-compute[75703]: </disk>
Nov 10 14:46:40 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6787f93d-692b-421c-8c3d-82dcb327aa00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d] added
Nov 10 14:46:40 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f447e2ed-7fd9-4730-8d24-2f4a9a4bd6e5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d67c1-9936-482d-9a59-a5d776940b7f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEtYmZRl {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEtYmZRl" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d693d-2f71-4e37-8777-667a072306ad]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fEtYmZRl'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd03f1-7d48-4e4c-9b5c-988644d517ae]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed7b8f9-157d-471d-8edb-36d57047c658]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b122fcc-416d-4103-b65a-67d83c554677]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260]
Nov 10 14:46:40 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:40 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76b8f2d-dbdf-444b-bacf-d2189b9954c9]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2ef7b-9e33-45f1-8cd3-6fc46cb20853]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:40 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0672d2e7-92bd-476e-929f-45a2d1cb423b]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:40 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No VIF found with MAC fa:16:3e:cf:1a:b4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 417333248 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-744bbf06-ef9c-4b62-9ce0-8e0a4d6ab03e tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 59.139s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 594542592 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== connect_volume: return (3501ms) {'type': 'block', 'scsi_wwn': '23338323665383862', 'path': '/dev/sdk'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338323665383862', 'path': '/dev/sdk'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:44:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1625523003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1625523003',id=12,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-u0in6oq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:59Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.objects.instance [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:46:42 user nova-compute[75703]:   <uuid>9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15</uuid>
Nov 10 14:46:42 user nova-compute[75703]:   <name>instance-0000000c</name>
Nov 10 14:46:42 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:46:42 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:46:42 user nova-compute[75703]:   <metadata>
Nov 10 14:46:42 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:46:42 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:46:42 user nova-compute[75703]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1625523003</nova:name>
Nov 10 14:46:42 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:46:38</nova:creationTime>
Nov 10 14:46:42 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:46:42 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:46:42 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:46:42 user nova-compute[75703]:       <nova:owner>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:user uuid="90957e8164224a1285c067f0313178a2">tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member</nova:user>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:project uuid="6b19b6b93f7b4e6dbe0ded4d084792f2">tempest-ServerBootFromVolumeStableRescueTest-2023657370</nova:project>
Nov 10 14:46:42 user nova-compute[75703]:       </nova:owner>
Nov 10 14:46:42 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:46:42 user nova-compute[75703]:       <nova:ports>
Nov 10 14:46:42 user nova-compute[75703]:         <nova:port uuid="4a7cd975-41b4-4c54-a814-a852835e2e5f">
Nov 10 14:46:42 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:46:42 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:42 user nova-compute[75703]:       </nova:ports>
Nov 10 14:46:42 user nova-compute[75703]:     </nova:instance>
Nov 10 14:46:42 user nova-compute[75703]:   </metadata>
Nov 10 14:46:42 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:46:42 user nova-compute[75703]:     <system>
Nov 10 14:46:42 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:46:42 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:46:42 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:46:42 user nova-compute[75703]:       <entry name="serial">9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15</entry>
Nov 10 14:46:42 user nova-compute[75703]:       <entry name="uuid">9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15</entry>
Nov 10 14:46:42 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:46:42 user nova-compute[75703]:     </system>
Nov 10 14:46:42 user nova-compute[75703]:   </sysinfo>
Nov 10 14:46:42 user nova-compute[75703]:   <os>
Nov 10 14:46:42 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:46:42 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:46:42 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:46:42 user nova-compute[75703]:   </os>
Nov 10 14:46:42 user nova-compute[75703]:   <features>
Nov 10 14:46:42 user nova-compute[75703]:     <acpi/>
Nov 10 14:46:42 user nova-compute[75703]:     <apic/>
Nov 10 14:46:42 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:46:42 user nova-compute[75703]:   </features>
Nov 10 14:46:42 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:46:42 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:46:42 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:46:42 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:46:42 user nova-compute[75703]:   </clock>
Nov 10 14:46:42 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:46:42 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:46:42 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:46:42 user nova-compute[75703]:   </cpu>
Nov 10 14:46:42 user nova-compute[75703]:   <devices>
Nov 10 14:46:42 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:46:42 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:42 user nova-compute[75703]:       <source dev="/dev/sdk"/>
Nov 10 14:46:42 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:46:42 user nova-compute[75703]:       <serial>20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d</serial>
Nov 10 14:46:42 user nova-compute[75703]:     </disk>
Nov 10 14:46:42 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:42 user nova-compute[75703]:       <mac address="fa:16:3e:f9:3f:94"/>
Nov 10 14:46:42 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:42 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:42 user nova-compute[75703]:       <target dev="tap4a7cd975-41"/>
Nov 10 14:46:42 user nova-compute[75703]:     </interface>
Nov 10 14:46:42 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:46:42 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/console.log" append="off"/>
Nov 10 14:46:42 user nova-compute[75703]:     </serial>
Nov 10 14:46:42 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:46:42 user nova-compute[75703]:     <video>
Nov 10 14:46:42 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:42 user nova-compute[75703]:     </video>
Nov 10 14:46:42 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:46:42 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:46:42 user nova-compute[75703]:     </rng>
Nov 10 14:46:42 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:46:42 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:46:42 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:46:42 user nova-compute[75703]:     </memballoon>
Nov 10 14:46:42 user nova-compute[75703]:   </devices>
Nov 10 14:46:42 user nova-compute[75703]: </domain>
Nov 10 14:46:42 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:44:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1625523003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1625523003',id=12,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-u0in6oq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:44:59Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG os_vif [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '600d151f-b0a1-5849-9fec-334758d8e3d5', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a7cd975-41, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a7cd975-41, col_values=(('qos', UUID('69c14c4f-22f1-4c0b-bfd9-f2c453ae4655')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a7cd975-41, col_values=(('external_ids', {'iface-id': '4a7cd975-41b4-4c54-a814-a852835e2e5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:3f:94', 'vm-uuid': '9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:42 user nova-compute[75703]: INFO os_vif [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41')
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No VIF found with MAC fa:16:3e:f9:3f:94, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:42 user nova-compute[75703]: INFO nova.compute.manager [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Rescuing
Nov 10 14:46:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 739246080 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-6300440e-3214-4572-9650-3ecad8c95ea7 req-e8b95e0b-74d1-4f85-935f-f8d88925c82b service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6300440e-3214-4572-9650-3ecad8c95ea7 req-e8b95e0b-74d1-4f85-935f-f8d88925c82b service nova] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6300440e-3214-4572-9650-3ecad8c95ea7 req-e8b95e0b-74d1-4f85-935f-f8d88925c82b service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6300440e-3214-4572-9650-3ecad8c95ea7 req-e8b95e0b-74d1-4f85-935f-f8d88925c82b service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-6300440e-3214-4572-9650-3ecad8c95ea7 req-e8b95e0b-74d1-4f85-935f-f8d88925c82b service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] No waiting events found dispatching network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:42 user nova-compute[75703]: WARNING nova.compute.manager [req-6300440e-3214-4572-9650-3ecad8c95ea7 req-e8b95e0b-74d1-4f85-935f-f8d88925c82b service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received unexpected event network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 for instance with vm_state building and task_state spawning.
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 843055104 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:46:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:46:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Instance spawned successfully.
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 1001390080 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:43 user nova-compute[75703]: INFO nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Took 8.08 seconds to spawn the instance on the hypervisor.
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:43 user nova-compute[75703]: INFO nova.compute.manager [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Took 9.28 seconds to build instance.
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-021a1f29-7c93-4ee2-bee6-61d8e7ca93c5 req-b7133cc2-9075-42e6-9d91-e8e75755e04c service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-021a1f29-7c93-4ee2-bee6-61d8e7ca93c5 req-b7133cc2-9075-42e6-9d91-e8e75755e04c service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-021a1f29-7c93-4ee2-bee6-61d8e7ca93c5 req-b7133cc2-9075-42e6-9d91-e8e75755e04c service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-021a1f29-7c93-4ee2-bee6-61d8e7ca93c5 req-b7133cc2-9075-42e6-9d91-e8e75755e04c service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-021a1f29-7c93-4ee2-bee6-61d8e7ca93c5 req-b7133cc2-9075-42e6-9d91-e8e75755e04c service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:43 user nova-compute[75703]: WARNING nova.compute.manager [req-021a1f29-7c93-4ee2-bee6-61d8e7ca93c5 req-b7133cc2-9075-42e6-9d91-e8e75755e04c service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state active and task_state rescuing.
Nov 10 14:46:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64cb3cd3-b337-434c-bac5-ee876444b5a6 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.464s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuwYnGry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:44 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e749c41-74b9-41a9-ad19-7524a89cfd9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:46:44 user nova-compute[75703]: No targets found.
Nov 10 14:46:44 user nova-compute[75703]: iSNS:
Nov 10 14:46:44 user nova-compute[75703]: No targets found.
Nov 10 14:46:44 user nova-compute[75703]: STATIC:
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612
Nov 10 14:46:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:44 user nova-compute[75703]: FIRMWARE:
Nov 10 14:46:44 user nova-compute[75703]: No targets found.
Nov 10 14:46:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:46:44 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:46:44 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93aec24-7629-417e-a941-d6840baae146]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7d3b14-3998-4941-90d5-e4956e27ccd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43cf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0fd88-ac07-4ec6-a435-ba4476357c99]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e21a5f-66f2-4909-9516-3192106a09f3]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cfb1cc-15f6-4e7a-85c6-0c08ffd65a1c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de05863-0446-45e9-8694-84e44465203e]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance destroyed successfully.
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca76301a-7c7c-4311-ab70-90570d727d42]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Attempting a stable device rescue
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75703) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 14:46:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Creating image(s)
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a61fde-9de0-476e-8be3-ddf0730be4e0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260]
Nov 10 14:46:44 user nova-compute[75703]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "d0885cfe92ad84f04c0fc9edd56c73c900678330" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "d0885cfe92ad84f04c0fc9edd56c73c900678330" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f509b52-467a-4e64-888d-b79c8a9d1612 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd2565-f993-4678-97e1-db89ef381bda]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] <== disconnect_volume: return (474ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:46:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjYhuep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'edc4e407-e824-4ee7-831b-fe0bf2ac4293', 'attached_at': '', 'detached_at': '', 'volume_id': 'c59a491b-173c-430b-9e3f-7d9af9f95962', 'serial'} {{(pid=75703) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 14:46:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] swap_volume: removing Cinder connection for volume 5f509b52-467a-4e64-888d-b79c8a9d1612 {{(pid=75703) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:46 user nova-compute[75703]: WARNING nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state active and task_state rescuing.
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:46 user nova-compute[75703]: WARNING nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state building and task_state spawning.
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:46 user nova-compute[75703]: WARNING nova.compute.manager [req-13cfe8b2-bdb0-42c5-8a81-474e3872226e req-c25003ee-9546-4e2e-9d63-70da023f6890 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state building and task_state spawning.
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.virt.images [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] 7d44229e-1a42-494d-9d9f-f0b76e5d1bce was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.part /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.part /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.converted" returned: 0 in 0.630s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "d0885cfe92ad84f04c0fc9edd56c73c900678330" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.365s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "d0885cfe92ad84f04c0fc9edd56c73c900678330" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "d0885cfe92ad84f04c0fc9edd56c73c900678330" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:46:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance spawned successfully.
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330 --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330,backing_fmt=raw /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: INFO nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Took 8.90 seconds to spawn the instance on the hypervisor.
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] swap_volume: Updating volume 5f509b52-467a-4e64-888d-b79c8a9d1612 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bMjYhuep", "auth_password": "tsSJN3RbBIuGhd", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "c59a491b-173c-430b-9e3f-7d9af9f95962"}, "status": "reserved", "instance": "edc4e407-e824-4ee7-831b-fe0bf2ac4293", "attached_at": "", "detached_at": "", "volume_id": "c59a491b-173c-430b-9e3f-7d9af9f95962", "serial": "c59a491b-173c-430b-9e3f-7d9af9f95962"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c59a491b-173c-430b-9e3f-7d9af9f95962', 'no_device': None, 'attachment_id': '021f09d3-a75e-4319-bd6e-540adafde562'} {{(pid=75703) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330,backing_fmt=raw /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue" returned: 0 in 0.075s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "d0885cfe92ad84f04c0fc9edd56c73c900678330" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'migration_context' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Object Instance<fc1109cf-0cf6-4d87-8665-c7afc31edc90> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Start _get_guest_xml network_info=[{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "vif_mac": "fa:16:3e:cf:1a:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7d44229e-1a42-494d-9d9f-f0b76e5d1bce', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'attachment_id': '009729c1-8cb7-4b48-af98-35e9440a9e29', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mazkwPgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'fc1109cf-0cf6-4d87-8665-c7afc31edc90', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'serial': 'b0e70bde-937c-4bb9-a1fc-0ca8e8936550'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'resources' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-66d0afb8-789d-4b05-a8f8-1b995214024a tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 42.443s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Object Instance<fc1109cf-0cf6-4d87-8665-c7afc31edc90> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'numa_topology' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:47 user nova-compute[75703]: INFO nova.compute.manager [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Took 108.95 seconds to build instance.
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Object Instance<fc1109cf-0cf6-4d87-8665-c7afc31edc90> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:46:47 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:47 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7a727b-3e77-4b00-9e29-c30a76952262 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 109.064s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Object Instance<fc1109cf-0cf6-4d87-8665-c7afc31edc90> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mazkwPgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:47 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:47 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:47 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b3804-8ebf-42ab-a4b9-7274497d3b20]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mazkwPgd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 14:46:47 user nova-compute[75703]: node.name = iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:46:47 user nova-compute[75703]: node.tpgt = -1
Nov 10 14:46:47 user nova-compute[75703]: node.startup = automatic
Nov 10 14:46:47 user nova-compute[75703]: node.leading_login = No
Nov 10 14:46:47 user nova-compute[75703]: iface.iscsi_ifacename = default
Nov 10 14:46:47 user nova-compute[75703]: iface.net_ifacename = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.ipaddress = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.prefix_len = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.hwaddress = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.transport_name = tcp
Nov 10 14:46:47 user nova-compute[75703]: iface.initiatorname = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.vlan_id = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.vlan_priority = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.vlan_state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.iface_num = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.mtu = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.port = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.bootproto = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.subnet_mask = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.gateway = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_alt_client_id = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_dns = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_learn_iqn = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_vendor_id_state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_vendor_id = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.dhcp_slp_da = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.fragmentation = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.gratuitous_arp = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.incoming_forwarding = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.tos_state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.tos = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.ttl = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.delayed_ack = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.tcp_nagle = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.tcp_wsf_state = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.tcp_wsf = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.tcp_timer_scale = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.tcp_timestamp = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.redirect = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.def_task_mgmt_timeout = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.header_digest = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.data_digest = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.immediate_data = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.initial_r2t = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.data_seq_inorder = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.data_pdu_inorder = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.erl = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.max_receive_data_len = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.first_burst_len = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.max_outstanding_r2t = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.max_burst_len = 0
Nov 10 14:46:47 user nova-compute[75703]: iface.chap_auth = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.bidi_chap = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.strict_login_compliance = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.discovery_auth = <empty>
Nov 10 14:46:47 user nova-compute[75703]: iface.discovery_logout = <empty>
Nov 10 14:46:47 user nova-compute[75703]: node.discovery_address = <empty>
Nov 10 14:46:47 user nova-compute[75703]: node.discovery_port = 0
Nov 10 14:46:47 user nova-compute[75703]: node.discovery_type = static
Nov 10 14:46:47 user nova-compute[75703]: node.session.initial_cmdsn = 0
Nov 10 14:46:47 user nova-compute[75703]: node.session.initial_login_retry_max = 8
Nov 10 14:46:47 user nova-compute[75703]: node.session.xmit_thread_priority = -20
Nov 10 14:46:47 user nova-compute[75703]: node.session.cmds_max = 128
Nov 10 14:46:47 user nova-compute[75703]: node.session.queue_depth = 32
Nov 10 14:46:47 user nova-compute[75703]: node.session.nr_sessions = 1
Nov 10 14:46:47 user nova-compute[75703]: node.session.auth.authmethod = CHAP
Nov 10 14:46:47 user nova-compute[75703]: node.session.auth.username = mazkwPgd
Nov 10 14:46:47 user nova-compute[75703]: node.session.auth.password = ***
Nov 10 14:46:47 user nova-compute[75703]: node.session.auth.username_in = <empty>
Nov 10 14:46:47 user nova-compute[75703]: node.session.auth.password_in = <empty>
Nov 10 14:46:47 user nova-compute[75703]: node.session.auth.chap_algs = MD5
Nov 10 14:46:47 user nova-compute[75703]: node.session.timeo.replacement_timeout = 120
Nov 10 14:46:47 user nova-compute[75703]: node.session.err_timeo.abort_timeout = 15
Nov 10 14:46:47 user nova-compute[75703]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 14:46:47 user nova-compute[75703]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 14:46:47 user nova-compute[75703]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.FastAbort = Yes
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.InitialR2T = No
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.ImmediateData = Yes
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.MaxConnections = 1
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 14:46:47 user nova-compute[75703]: node.session.iscsi.ERL = 0
Nov 10 14:46:47 user nova-compute[75703]: node.session.scan = manual
Nov 10 14:46:47 user nova-compute[75703]: node.session.reopen_max = 0
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].address = 172.16.0.220
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].port = 3260
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].startup = manual
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].tcp.window_size = 524288
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].tcp.type_of_service = 0
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].timeo.logout_timeout = 15
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].timeo.login_timeout = 15
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].timeo.auth_timeout = 45
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].iscsi.DataDigest = None
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].iscsi.IFMarker = No
Nov 10 14:46:47 user nova-compute[75703]: node.conn[0].iscsi.OFMarker = No
Nov 10 14:46:47 user nova-compute[75703]: # END RECORD
Nov 10 14:46:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c48206-39bc-4ddc-949b-5ffbe7ef9757]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d8f9f-1251-4e22-a48e-4869695bfc9b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mazkwPgd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mazkwPgd" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa2c5e-76a1-4a68-a298-b4e7e3845b71]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mazkwPgd'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0f22e7-0884-4e58-a4ac-7ecf74656e9a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[505bfc68-3e77-4070-93a5-e33a21873bd3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.191s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] HCTL ('41', '0', '0', 0) found on session 11 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Scanning host 41 c: 0, t: 0, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[584bd713-800e-4958-994e-42ddbde9de1e]: (4, ('0 0 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Searching for a device in session 11 and hctl ('41', '0', '0', 0) yield: sdj {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mazkwPgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.234s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '26639663361393166', 'path': '/dev/sdj'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639663361393166', 'path': '/dev/sdj'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-973695654',display_name='tempest-ServerStableDeviceRescueTest-server-973695654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-973695654',id=1,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB0V31H1LE0jq8ZHwwOYuY9dh6WAUutxUkKcEDq7GRuM71BtAMyAgvVfoaFDb5lhfiZ0xCHhSRBFq4A1BW68hQ1LJZ78+hhD/PbgkiPfmsJEGA9m9Uy6WStDohrTBc7pQ==',key_name='tempest-keypair-1749947703',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5457f288fd44363b1ffc72ec62ee2ea',ramdisk_id='',reservation_id='r-yxtlxmkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-664853568',owner_user_name='tempest-ServerStableDeviceRescueTest-664853568-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65434c01ab4a483a9875ac4d4dfb9993',uuid=fc1109cf-0cf6-4d87-8665-c7afc31edc90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "vif_mac": "fa:16:3e:cf:1a:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converting VIF {"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "vif_mac": "fa:16:3e:cf:1a:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'pci_devices' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.objects.base [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Object Instance<fc1109cf-0cf6-4d87-8665-c7afc31edc90> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:46:47 user nova-compute[75703]:   <uuid>fc1109cf-0cf6-4d87-8665-c7afc31edc90</uuid>
Nov 10 14:46:47 user nova-compute[75703]:   <name>instance-00000001</name>
Nov 10 14:46:47 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:46:47 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:46:47 user nova-compute[75703]:   <metadata>
Nov 10 14:46:47 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:46:47 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:46:47 user nova-compute[75703]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-973695654</nova:name>
Nov 10 14:46:47 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:46:47</nova:creationTime>
Nov 10 14:46:47 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:46:47 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:46:47 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:46:47 user nova-compute[75703]:       <nova:owner>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:user uuid="65434c01ab4a483a9875ac4d4dfb9993">tempest-ServerStableDeviceRescueTest-664853568-project-member</nova:user>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:project uuid="c5457f288fd44363b1ffc72ec62ee2ea">tempest-ServerStableDeviceRescueTest-664853568</nova:project>
Nov 10 14:46:47 user nova-compute[75703]:       </nova:owner>
Nov 10 14:46:47 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:46:47 user nova-compute[75703]:       <nova:ports>
Nov 10 14:46:47 user nova-compute[75703]:         <nova:port uuid="745e6c01-21df-4938-b4de-de63abaafea2">
Nov 10 14:46:47 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 14:46:47 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:47 user nova-compute[75703]:       </nova:ports>
Nov 10 14:46:47 user nova-compute[75703]:     </nova:instance>
Nov 10 14:46:47 user nova-compute[75703]:   </metadata>
Nov 10 14:46:47 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:46:47 user nova-compute[75703]:     <system>
Nov 10 14:46:47 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:46:47 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:46:47 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:46:47 user nova-compute[75703]:       <entry name="serial">fc1109cf-0cf6-4d87-8665-c7afc31edc90</entry>
Nov 10 14:46:47 user nova-compute[75703]:       <entry name="uuid">fc1109cf-0cf6-4d87-8665-c7afc31edc90</entry>
Nov 10 14:46:47 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:46:47 user nova-compute[75703]:     </system>
Nov 10 14:46:47 user nova-compute[75703]:   </sysinfo>
Nov 10 14:46:47 user nova-compute[75703]:   <os>
Nov 10 14:46:47 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:46:47 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:46:47 user nova-compute[75703]:   </os>
Nov 10 14:46:47 user nova-compute[75703]:   <features>
Nov 10 14:46:47 user nova-compute[75703]:     <acpi/>
Nov 10 14:46:47 user nova-compute[75703]:     <apic/>
Nov 10 14:46:47 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:46:47 user nova-compute[75703]:   </features>
Nov 10 14:46:47 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:46:47 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:46:47 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:46:47 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:46:47 user nova-compute[75703]:   </clock>
Nov 10 14:46:47 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:46:47 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:46:47 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:46:47 user nova-compute[75703]:   </cpu>
Nov 10 14:46:47 user nova-compute[75703]:   <devices>
Nov 10 14:46:47 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:46:47 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:46:47 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk"/>
Nov 10 14:46:47 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:46:47 user nova-compute[75703]:     </disk>
Nov 10 14:46:47 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:46:47 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:46:47 user nova-compute[75703]:       <source dev="/dev/sdj"/>
Nov 10 14:46:47 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:46:47 user nova-compute[75703]:       <serial>b0e70bde-937c-4bb9-a1fc-0ca8e8936550</serial>
Nov 10 14:46:47 user nova-compute[75703]:     </disk>
Nov 10 14:46:47 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:46:47 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:46:47 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue"/>
Nov 10 14:46:47 user nova-compute[75703]:       <target dev="vdc" bus="virtio"/>
Nov 10 14:46:47 user nova-compute[75703]:       <boot order="1"/>
Nov 10 14:46:47 user nova-compute[75703]:     </disk>
Nov 10 14:46:47 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:47 user nova-compute[75703]:       <mac address="fa:16:3e:cf:1a:b4"/>
Nov 10 14:46:47 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:47 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:47 user nova-compute[75703]:       <target dev="tap745e6c01-21"/>
Nov 10 14:46:47 user nova-compute[75703]:     </interface>
Nov 10 14:46:47 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:46:47 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/console.log" append="off"/>
Nov 10 14:46:47 user nova-compute[75703]:     </serial>
Nov 10 14:46:47 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:46:47 user nova-compute[75703]:     <video>
Nov 10 14:46:47 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:47 user nova-compute[75703]:     </video>
Nov 10 14:46:47 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:46:47 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:46:47 user nova-compute[75703]:     </rng>
Nov 10 14:46:47 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:46:47 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:46:47 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:46:47 user nova-compute[75703]:     </memballoon>
Nov 10 14:46:47 user nova-compute[75703]:   </devices>
Nov 10 14:46:47 user nova-compute[75703]: </domain>
Nov 10 14:46:47 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:46:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance destroyed successfully.
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] No VIF found with MAC fa:16:3e:cf:1a:b4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG os_brick.utils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36e1282-233d-4a8b-87ba-c0c1d76013cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd8a5a-6b2d-496f-a26e-24fff9a819a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c40a4f-9b41-42cd-b428-1c936f205418]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[984228aa-4987-4251-b371-2a2cac334e34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:46:48 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:46:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d63fc0-0449-467b-9550-370c5865babb]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:46:48 user nova-compute[75703]: DEBUG os_brick.utils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:48 user nova-compute[75703]: INFO nova.compute.manager [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Swapping volume c59a491b-173c-430b-9e3f-7d9af9f95962 for 5f509b52-467a-4e64-888d-b79c8a9d1612
Nov 10 14:46:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-e463f974-c65e-45f3-94af-c3d300202d2c req-798151f3-f703-46af-9c5f-9fdad5e1bd83 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e463f974-c65e-45f3-94af-c3d300202d2c req-798151f3-f703-46af-9c5f-9fdad5e1bd83 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e463f974-c65e-45f3-94af-c3d300202d2c req-798151f3-f703-46af-9c5f-9fdad5e1bd83 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e463f974-c65e-45f3-94af-c3d300202d2c req-798151f3-f703-46af-9c5f-9fdad5e1bd83 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-e463f974-c65e-45f3-94af-c3d300202d2c req-798151f3-f703-46af-9c5f-9fdad5e1bd83 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:49 user nova-compute[75703]: WARNING nova.compute.manager [req-e463f974-c65e-45f3-94af-c3d300202d2c req-798151f3-f703-46af-9c5f-9fdad5e1bd83 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state active and task_state rescuing.
Nov 10 14:46:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-97ea2e7c-8ce0-4e9d-a4a3-1eefc2e7244a req-5354af6d-ba39-45e5-af74-b3099861e5d0 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-97ea2e7c-8ce0-4e9d-a4a3-1eefc2e7244a req-5354af6d-ba39-45e5-af74-b3099861e5d0 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-97ea2e7c-8ce0-4e9d-a4a3-1eefc2e7244a req-5354af6d-ba39-45e5-af74-b3099861e5d0 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-97ea2e7c-8ce0-4e9d-a4a3-1eefc2e7244a req-5354af6d-ba39-45e5-af74-b3099861e5d0 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-97ea2e7c-8ce0-4e9d-a4a3-1eefc2e7244a req-5354af6d-ba39-45e5-af74-b3099861e5d0 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:46:51 user nova-compute[75703]: WARNING nova.compute.manager [req-97ea2e7c-8ce0-4e9d-a4a3-1eefc2e7244a req-5354af6d-ba39-45e5-af74-b3099861e5d0 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state active and task_state rescuing.
Nov 10 14:46:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:52 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2972ad98-27c4-4c1e-848c-8e54892e4914 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:46:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:46:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:46:56 user nova-compute[75703]: INFO nova.compute.claims [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Claim successful on node user
Nov 10 14:46:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:46:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.policy [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23ee54b16d604b829f2088d8e850c48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ddb2fd8ebd40b0bee398bd9969a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:46:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Creating image(s)
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "/opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "/opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "/opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk 1073741824" returned: 0 in 0.071s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Successfully created port: 11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.234s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Cannot resize image /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Ensure instance console log exists: /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:46:58 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 2d61611e-951c-4789-87b4-44221eff8be7 is timed out.
Nov 10 14:46:58 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Successfully detached device sdc from instance 2d61611e-951c-4789-87b4-44221eff8be7 from the live domain config.
Nov 10 14:46:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geRavTMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:58 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c10e50-8ca0-471e-9b3c-a34a9edcc959]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:46:58 user nova-compute[75703]: No targets found.
Nov 10 14:46:58 user nova-compute[75703]: iSNS:
Nov 10 14:46:58 user nova-compute[75703]: No targets found.
Nov 10 14:46:58 user nova-compute[75703]: STATIC:
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4
Nov 10 14:46:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:58 user nova-compute[75703]: FIRMWARE:
Nov 10 14:46:58 user nova-compute[75703]: No targets found.
Nov 10 14:46:58 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:46:58 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:46:58 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e850f1-32c8-4430-874a-630cab759590]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f05f4d3-e8b5-42d6-b39d-7936fe5d4a24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:58 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4742560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f'): ({'sde'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Removing single pathed devices sde {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75caa9-54e6-4cc1-ace1-8e7d7a248b41]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d9a3e6-315e-4ce2-b5de-8a491224be59]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Flushing IO for device /dev/sde {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96000b-97f5-422b-b39e-4a4a8268a6b0]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3205e3-dabd-4eb9-ac10-4fa362e8e6a6]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:46:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b9927f87-7338-4b59-a675-d122ff035659 is timed out.
Nov 10 14:46:59 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc2a6989-8214-499a-b2d4-b8c88225a992 is timed out.
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Successfully detached device vdb from instance b9927f87-7338-4b59-a675-d122ff035659 from the live domain config.
Nov 10 14:46:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Successfully detached device vdb from instance cc2a6989-8214-499a-b2d4-b8c88225a992 from the live domain config.
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00ab3df-7b53-4c4c-b52a-6e97dffcaa80]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSNqgscd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:59 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GhVvxTWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:46:59 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7148c04-835a-4364-aec9-4fc6bd2a5680]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260]
Nov 10 14:46:59 user nova-compute[75703]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2511149-7eb3-4e70-bc48-e8f437b7200f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b888a-5b41-4cc1-b6c7-8f391dd46510]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] <== disconnect_volume: return (398ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Successfully updated port: 11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.146s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb0ba9f-d914-41de-b83c-f0629bff28b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:46:59 user nova-compute[75703]: No targets found.
Nov 10 14:46:59 user nova-compute[75703]: iSNS:
Nov 10 14:46:59 user nova-compute[75703]: No targets found.
Nov 10 14:46:59 user nova-compute[75703]: STATIC:
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: FIRMWARE:
Nov 10 14:46:59 user nova-compute[75703]: No targets found.
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:46:59 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:46:59 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[612a1769-f643-4e7a-9df4-b91075467998]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc2b6e2-f738-4501-aa1a-d834aa779285]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4761900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f'): ({'sdd'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Removing single pathed devices sdd {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-changed-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Refreshing instance network info cache due to event network-changed-11e5b42e-cf66-4a9e-88b7-818c7c13bee5. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[120c09e3-02db-4945-b7d5-c5d606708764]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab81ef7d-65a0-4c89-81b7-73e82aa66b79]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Flushing IO for device /dev/sdd {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37a57b-335c-4051-901b-36645f5bcaa4]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362f015-9572-4405-b7d3-22698fd0fd55]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9485a2-3ead-4176-8732-3d1db2eee97c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5600ee-1faf-4532-9f56-d54ded32faf4]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260]
Nov 10 14:46:59 user nova-compute[75703]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c32fc4a-9b3c-45db-8966-1279f450126f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a986967-f3b4-4583-8095-337cc4c77263]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] <== disconnect_volume: return (494ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] [instance: b9927f87-7338-4b59-a675-d122ff035659] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.495s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Instance network_info: |[{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Refreshing network info cache for port 11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Start _get_guest_xml network_info=[{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc6847b-15bb-4994-9f0b-5a84e3c62e46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:46:59 user nova-compute[75703]: No targets found.
Nov 10 14:46:59 user nova-compute[75703]: iSNS:
Nov 10 14:46:59 user nova-compute[75703]: No targets found.
Nov 10 14:46:59 user nova-compute[75703]: STATIC:
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4
Nov 10 14:46:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:46:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:46:59 user nova-compute[75703]: FIRMWARE:
Nov 10 14:46:59 user nova-compute[75703]: No targets found.
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:46:59 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:46:59 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:59 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2016906769',display_name='tempest-ServerActionsTestOtherA-server-2016906769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2016906769',id=14,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-e4z8jmj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=642d3e1d-4973-4759-8396-0cf73dcfce41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'pci_devices' on Instance uuid 642d3e1d-4973-4759-8396-0cf73dcfce41 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[03625990-3d78-4452-a19b-c0fb21bb6ec0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:46:59 user nova-compute[75703]:   <uuid>642d3e1d-4973-4759-8396-0cf73dcfce41</uuid>
Nov 10 14:46:59 user nova-compute[75703]:   <name>instance-0000000e</name>
Nov 10 14:46:59 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:46:59 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:46:59 user nova-compute[75703]:   <metadata>
Nov 10 14:46:59 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:46:59 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:46:59 user nova-compute[75703]:       <nova:name>tempest-ServerActionsTestOtherA-server-2016906769</nova:name>
Nov 10 14:46:59 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:46:59</nova:creationTime>
Nov 10 14:46:59 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:46:59 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:46:59 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:46:59 user nova-compute[75703]:       <nova:owner>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:user uuid="23ee54b16d604b829f2088d8e850c48c">tempest-ServerActionsTestOtherA-1989770067-project-member</nova:user>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:project uuid="37ddb2fd8ebd40b0bee398bd9969a0ee">tempest-ServerActionsTestOtherA-1989770067</nova:project>
Nov 10 14:46:59 user nova-compute[75703]:       </nova:owner>
Nov 10 14:46:59 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:46:59 user nova-compute[75703]:       <nova:ports>
Nov 10 14:46:59 user nova-compute[75703]:         <nova:port uuid="11e5b42e-cf66-4a9e-88b7-818c7c13bee5">
Nov 10 14:46:59 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:46:59 user nova-compute[75703]:         </nova:port>
Nov 10 14:46:59 user nova-compute[75703]:       </nova:ports>
Nov 10 14:46:59 user nova-compute[75703]:     </nova:instance>
Nov 10 14:46:59 user nova-compute[75703]:   </metadata>
Nov 10 14:46:59 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:46:59 user nova-compute[75703]:     <system>
Nov 10 14:46:59 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:46:59 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:46:59 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:46:59 user nova-compute[75703]:       <entry name="serial">642d3e1d-4973-4759-8396-0cf73dcfce41</entry>
Nov 10 14:46:59 user nova-compute[75703]:       <entry name="uuid">642d3e1d-4973-4759-8396-0cf73dcfce41</entry>
Nov 10 14:46:59 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:46:59 user nova-compute[75703]:     </system>
Nov 10 14:46:59 user nova-compute[75703]:   </sysinfo>
Nov 10 14:46:59 user nova-compute[75703]:   <os>
Nov 10 14:46:59 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:46:59 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:46:59 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:46:59 user nova-compute[75703]:   </os>
Nov 10 14:46:59 user nova-compute[75703]:   <features>
Nov 10 14:46:59 user nova-compute[75703]:     <acpi/>
Nov 10 14:46:59 user nova-compute[75703]:     <apic/>
Nov 10 14:46:59 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:46:59 user nova-compute[75703]:   </features>
Nov 10 14:46:59 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:46:59 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:46:59 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:46:59 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:46:59 user nova-compute[75703]:   </clock>
Nov 10 14:46:59 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:46:59 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:46:59 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:46:59 user nova-compute[75703]:   </cpu>
Nov 10 14:46:59 user nova-compute[75703]:   <devices>
Nov 10 14:46:59 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:46:59 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:46:59 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk"/>
Nov 10 14:46:59 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:46:59 user nova-compute[75703]:     </disk>
Nov 10 14:46:59 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:46:59 user nova-compute[75703]:       <mac address="fa:16:3e:9a:a6:46"/>
Nov 10 14:46:59 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:59 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:46:59 user nova-compute[75703]:       <target dev="tap11e5b42e-cf"/>
Nov 10 14:46:59 user nova-compute[75703]:     </interface>
Nov 10 14:46:59 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:46:59 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/console.log" append="off"/>
Nov 10 14:46:59 user nova-compute[75703]:     </serial>
Nov 10 14:46:59 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:46:59 user nova-compute[75703]:     <video>
Nov 10 14:46:59 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:46:59 user nova-compute[75703]:     </video>
Nov 10 14:46:59 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:46:59 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:46:59 user nova-compute[75703]:     </rng>
Nov 10 14:46:59 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:46:59 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:46:59 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:46:59 user nova-compute[75703]:     </memballoon>
Nov 10 14:46:59 user nova-compute[75703]:   </devices>
Nov 10 14:46:59 user nova-compute[75703]: </domain>
Nov 10 14:46:59 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2016906769',display_name='tempest-ServerActionsTestOtherA-server-2016906769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2016906769',id=14,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-e4z8jmj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=642d3e1d-4973-4759-8396-0cf73dcfce41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_vif [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b64cc1c-4148-5c6d-adbe-53f5a701e6b2', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11e5b42e-cf, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11e5b42e-cf, col_values=(('qos', UUID('2dd6e323-d8ba-4d6c-8b8e-828fe3e50a1d')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11e5b42e-cf, col_values=(('external_ids', {'iface-id': '11e5b42e-cf66-4a9e-88b7-818c7c13bee5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:a6:46', 'vm-uuid': '642d3e1d-4973-4759-8396-0cf73dcfce41'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ade82d7-1f80-4c82-9f85-1b2fce0d6236]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a420c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:46:59 user nova-compute[75703]: INFO os_vif [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf')
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33692f-627e-479c-a625-08ecb5224041]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5b4685-b72b-4146-bc1a-d9afec9ce90e]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No VIF found with MAC fa:16:3e:9a:a6:46, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e840bf1-fb34-4124-a8e4-2eed277f37d1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc362a98-8d69-43c5-8ad8-07741ac920a4]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a121658-c86f-4baf-a284-8aa81d882a7b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[98feb244-25e8-4f78-9e02-96268d1c672e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260]
Nov 10 14:46:59 user nova-compute[75703]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f, portal: 172.16.0.220,3260] successful.
Nov 10 14:46:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updated VIF entry in instance network info cache for port 11e5b42e-cf66-4a9e-88b7-818c7c13bee5. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.network.neutron [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:342876fd-d96b-4d0c-a44f-5524e79ec40f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d955c-b8d1-4dd1-9057-02eafac3506d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] <== disconnect_volume: return (920ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:46:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-074e7ac5-baa4-4024-9899-1393a6ebc62b req-993bacb6-93ef-4872-8d91-a7327be6d36c service nova] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-79d1fd35-83f2-4d4c-b23a-5b3b0e48b8b5 req-af58fb82-472e-4ae2-bcfb-2cd340304766 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-79d1fd35-83f2-4d4c-b23a-5b3b0e48b8b5 req-af58fb82-472e-4ae2-bcfb-2cd340304766 service nova] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-79d1fd35-83f2-4d4c-b23a-5b3b0e48b8b5 req-af58fb82-472e-4ae2-bcfb-2cd340304766 service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-79d1fd35-83f2-4d4c-b23a-5b3b0e48b8b5 req-af58fb82-472e-4ae2-bcfb-2cd340304766 service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-79d1fd35-83f2-4d4c-b23a-5b3b0e48b8b5 req-af58fb82-472e-4ae2-bcfb-2cd340304766 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] No waiting events found dispatching network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:01 user nova-compute[75703]: WARNING nova.compute.manager [req-79d1fd35-83f2-4d4c-b23a-5b3b0e48b8b5 req-af58fb82-472e-4ae2-bcfb-2cd340304766 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received unexpected event network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 for instance with vm_state building and task_state spawning.
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:47:03 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Instance spawned successfully.
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:47:03 user nova-compute[75703]: INFO nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:47:03 user nova-compute[75703]: INFO nova.compute.manager [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Took 6.79 seconds to build instance.
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d1cb7ae6-ef41-4e03-a514-71af6d1979a3 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.915s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-16225d0b-d4cc-4c19-9f59-e7a799a081b4 req-e736f4ff-be6c-4f57-a0ec-6797bd4a12ee service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-16225d0b-d4cc-4c19-9f59-e7a799a081b4 req-e736f4ff-be6c-4f57-a0ec-6797bd4a12ee service nova] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-16225d0b-d4cc-4c19-9f59-e7a799a081b4 req-e736f4ff-be6c-4f57-a0ec-6797bd4a12ee service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-16225d0b-d4cc-4c19-9f59-e7a799a081b4 req-e736f4ff-be6c-4f57-a0ec-6797bd4a12ee service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-16225d0b-d4cc-4c19-9f59-e7a799a081b4 req-e736f4ff-be6c-4f57-a0ec-6797bd4a12ee service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] No waiting events found dispatching network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:03 user nova-compute[75703]: WARNING nova.compute.manager [req-16225d0b-d4cc-4c19-9f59-e7a799a081b4 req-e736f4ff-be6c-4f57-a0ec-6797bd4a12ee service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received unexpected event network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 for instance with vm_state active and task_state None.
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating instance_info_cache with network_info: [{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:47:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=25.2091064453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d4465989-c669-4edd-b7d2-f71e203b7142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2d61611e-951c-4789-87b4-44221eff8be7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b9927f87-7338-4b59-a675-d122ff035659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 571c71fd-4b7b-40b5-a728-be8b30580da5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:47:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:47:10 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:47:10 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:47:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:47:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOBwRxon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:47:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:47:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:47:11 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecaad01-fa41-4d88-ba2c-4c72177ffede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:47:11 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4fd00-dc05-4945-9523-486485b8fd74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150] added
Nov 10 14:47:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1f1ff-cf02-4fa5-b5b5-eab751b15a80]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e4792-8d4d-4a09-9640-682d74d3b1f7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOBwRxon {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOBwRxon" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d8aef8-026e-4a3a-81e0-af3fe4440c12]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOBwRxon'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcff5dd-d8bd-488e-8d05-1daae7ac2e41]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d196f03-f8c9-48d7-be15-17c7c8c11a41]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d8226-c250-409e-b071-a18d42bb379b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260]
Nov 10 14:47:11 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260] successful.
Nov 10 14:47:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67901a-00de-4886-9406-a957833a502d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b431bc-dce2-491a-ac6d-1ba06202be97]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9438e7d5-ee64-492d-a17d-3d76c72255d4]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:47:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOBwRxon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:47:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:47:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23966326164623833', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:47:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966326164623833', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:47:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lazy-loading 'flavor' on Instance uuid d4465989-c669-4edd-b7d2-f71e203b7142 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:47:12 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:47:12 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:47:12 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:47:12 user nova-compute[75703]:   <serial>90f9c0ae-b616-49cc-8f44-7e3ef7aff150</serial>
Nov 10 14:47:12 user nova-compute[75703]: </disk>
Nov 10 14:47:12 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:47:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lazy-loading 'flavor' on Instance uuid 2d61611e-951c-4789-87b4-44221eff8be7 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-06e12bce-6b5f-400b-a32b-ccdce098bf51 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 66.999s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:47:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:47:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] No VIF found with MAC fa:16:3e:c6:fe:4d, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:47:13 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lazy-loading 'flavor' on Instance uuid b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f8fef220-9ee9-4799-a9cd-296136d8d43a tempest-VolumesAssistedSnapshotsTest-831646338 tempest-VolumesAssistedSnapshotsTest-831646338-project-admin] Lock "b9927f87-7338-4b59-a675-d122ff035659" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 67.928s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.volume.cinder [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Update attachment failed for attachment a9264c33-39b2-4c82-b256-bd2d64b293cf. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.volume.cinder [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Update attachment failed for attachment aefbcc75-f3d3-49f9-8bdf-8f1ce5c85133. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6fc341e2-3882-40ba-b931-c669d4fafe00) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6fc341e2-3882-40ba-b931-c669d4fafe00)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Failed to connect to volume 5f509b52-467a-4e64-888d-b79c8a9d1612 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6fc341e2-3882-40ba-b931-c669d4fafe00)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Traceback (most recent call last):
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     new_cinfo = self.volume_api.attachment_update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     res = method(self, ctx, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     return method.func(obj, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     return self.request(url, method, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293]     raise exceptions.from_response(resp, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6fc341e2-3882-40ba-b931-c669d4fafe00)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] 
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808] Traceback (most recent call last):
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     driver_block_device.attach_block_devices(
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     _log_and_attach(device)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     self._do_attach(context, instance, volume, volume_api,
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     self._volume_attach(context, volume, connector, instance,
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     connection_info = volume_api.attachment_update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     res = method(self, ctx, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     return method.func(obj, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     return self.request(url, method, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808]     raise exceptions.from_response(resp, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec)
Nov 10 14:47:14 user nova-compute[75703]: ERROR nova.compute.manager [instance: 29e60285-ce7c-4b88-b013-458e19039808] 
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "29e60285-ce7c-4b88-b013-458e19039808" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 67.316s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:14 user nova-compute[75703]: INFO nova.compute.manager [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 29e60285-ce7c-4b88-b013-458e19039808] Successfully reverted task state from spawning on failure for instance.
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server [None req-e67aff3e-7468-4c73-a0e8-b35e0c025820 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7083, in unshelve_instance
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7080, in do_unshelve_instance
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7112, in _unshelve_instance
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20c07266-b066-414b-914f-62266ced20ec)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-24c0939a-fa30-4661-931a-0d48b8dcbdf3 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.826s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 26.428s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server [None req-6d648a4d-7565-4b19-99c7-c0df6790af88 tempest-TestVolumeSwap-341537426 tempest-TestVolumeSwap-341537426-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6fc341e2-3882-40ba-b931-c669d4fafe00)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6fc341e2-3882-40ba-b931-c669d4fafe00)
Nov 10 14:47:14 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:14 user nova-compute[75703]: INFO nova.compute.manager [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Terminating instance
Nov 10 14:47:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.objects.instance [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'flavor' on Instance uuid cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-25c912ae-e026-4997-b98b-2e3282f71dd7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 69.907s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-ac1ae46d-e532-4787-a6fe-379a478670c0 req-51dabd65-6105-446e-bc3b-9a9d56e4506a service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-vif-unplugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ac1ae46d-e532-4787-a6fe-379a478670c0 req-51dabd65-6105-446e-bc3b-9a9d56e4506a service nova] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ac1ae46d-e532-4787-a6fe-379a478670c0 req-51dabd65-6105-446e-bc3b-9a9d56e4506a service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ac1ae46d-e532-4787-a6fe-379a478670c0 req-51dabd65-6105-446e-bc3b-9a9d56e4506a service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-ac1ae46d-e532-4787-a6fe-379a478670c0 req-51dabd65-6105-446e-bc3b-9a9d56e4506a service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] No waiting events found dispatching network-vif-unplugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-ac1ae46d-e532-4787-a6fe-379a478670c0 req-51dabd65-6105-446e-bc3b-9a9d56e4506a service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-vif-unplugged-cc950fa0-159b-45bc-a995-f601ea7fed01 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Instance destroyed successfully.
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lazy-loading 'resources' on Instance uuid 2d61611e-951c-4789-87b4-44221eff8be7 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-553601083',display_name='tempest-AttachSCSIVolumeTestJSON-server-553601083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-553601083',id=7,image_ref='fb148462-af70-418c-8126-ce805f9f5a27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk+0be5r6KSpUGZGZrvEE7kQvNk8gASdWDGDlpvEM2ze5r5SIaAwtJuD+48EEjM3oT6aluEDWnl7RkeD3GUAEKPRx2mAR/pdzLwL5RGXIV39ZOpOdgi/CV/vdClZBAnwg==',key_name='tempest-keypair-432803700',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30b3313b480b4cdb9c2c3b27b97361b7',ramdisk_id='',reservation_id='r-f1498cdc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb148462-af70-418c-8126-ce805f9f5a27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1805005288',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1805005288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:42:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0aaea6310b434bcf9c35b94ab2262f21',uuid=2d61611e-951c-4789-87b4-44221eff8be7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Converting VIF {"id": "cc950fa0-159b-45bc-a995-f601ea7fed01", "address": "fa:16:3e:59:85:83", "network": {"id": "923be8b1-be5d-4498-8126-be905ea3aa9a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1685319484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b3313b480b4cdb9c2c3b27b97361b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc950fa0-15", "ovs_interfaceid": "cc950fa0-159b-45bc-a995-f601ea7fed01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG os_vif [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc950fa0-15, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97c420e7-a27a-48ee-b9a0-2f0b0dba0a5f) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:15 user nova-compute[75703]: INFO os_vif [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:85:83,bridge_name='br-int',has_traffic_filtering=True,id=cc950fa0-159b-45bc-a995-f601ea7fed01,network=Network(923be8b1-be5d-4498-8126-be905ea3aa9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc950fa0-15')
Nov 10 14:47:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Deleting instance files /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7_del
Nov 10 14:47:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Deletion of /opt/stack/data/nova/instances/2d61611e-951c-4789-87b4-44221eff8be7_del complete
Nov 10 14:47:15 user nova-compute[75703]: INFO nova.compute.manager [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 14:47:15 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:47:15 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:47:16 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-6d541e60-9cff-4e9f-82e4-829f5ac29bcf req-a1d529c0-7101-4b66-ae04-dd8a2d4420e0 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-vif-deleted-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:16 user nova-compute[75703]: INFO nova.compute.manager [req-6d541e60-9cff-4e9f-82e4-829f5ac29bcf req-a1d529c0-7101-4b66-ae04-dd8a2d4420e0 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Neutron deleted interface cc950fa0-159b-45bc-a995-f601ea7fed01; detaching it from the instance and deleting it from the info cache
Nov 10 14:47:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-6d541e60-9cff-4e9f-82e4-829f5ac29bcf req-a1d529c0-7101-4b66-ae04-dd8a2d4420e0 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:16 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Took 0.84 seconds to deallocate network for instance.
Nov 10 14:47:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-6d541e60-9cff-4e9f-82e4-829f5ac29bcf req-a1d529c0-7101-4b66-ae04-dd8a2d4420e0 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Detach interface failed, port_id=cc950fa0-159b-45bc-a995-f601ea7fed01, reason: Instance 2d61611e-951c-4789-87b4-44221eff8be7 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:47:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Stashing vm_state: active {{(pid=75703) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.097s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:47:17 user nova-compute[75703]: INFO nova.compute.claims [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Claim successful on node user
Nov 10 14:47:17 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Deleted allocations for instance 2d61611e-951c-4789-87b4-44221eff8be7
Nov 10 14:47:17 user nova-compute[75703]: INFO nova.compute.resource_tracker [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating resource usage from migration 6f8a93a9-e501-4887-8129-01b16277ba06
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d8b60eed-8ef3-4e9b-84ac-332097338cf7 tempest-AttachSCSIVolumeTestJSON-1805005288 tempest-AttachSCSIVolumeTestJSON-1805005288-project-member] Lock "2d61611e-951c-4789-87b4-44221eff8be7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-88ea7472-92f0-4096-ac2a-055b50947bdd req-a69547f9-016d-4e35-8a42-f00cbaa41d31 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received event network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88ea7472-92f0-4096-ac2a-055b50947bdd req-a69547f9-016d-4e35-8a42-f00cbaa41d31 service nova] Acquiring lock "2d61611e-951c-4789-87b4-44221eff8be7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88ea7472-92f0-4096-ac2a-055b50947bdd req-a69547f9-016d-4e35-8a42-f00cbaa41d31 service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88ea7472-92f0-4096-ac2a-055b50947bdd req-a69547f9-016d-4e35-8a42-f00cbaa41d31 service nova] Lock "2d61611e-951c-4789-87b4-44221eff8be7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-88ea7472-92f0-4096-ac2a-055b50947bdd req-a69547f9-016d-4e35-8a42-f00cbaa41d31 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] No waiting events found dispatching network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:17 user nova-compute[75703]: WARNING nova.compute.manager [req-88ea7472-92f0-4096-ac2a-055b50947bdd req-a69547f9-016d-4e35-8a42-f00cbaa41d31 service nova] [instance: 2d61611e-951c-4789-87b4-44221eff8be7] Received unexpected event network-vif-plugged-cc950fa0-159b-45bc-a995-f601ea7fed01 for instance with vm_state deleted and task_state None.
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.517s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:17 user nova-compute[75703]: INFO nova.compute.manager [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Migrating
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:17 user nova-compute[75703]: INFO nova.compute.rpcapi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquired lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Releasing lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Starting migrate_disk_and_power_off {{(pid=75703) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:19 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance destroyed successfully.
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1906531598',display_name='tempest-ServerActionsTestOtherB-server-1906531598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1906531598',id=5,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARDx9Ux4B6BMgGtjVpZzzTTyYZVM+QY3vwtyHv2g+7qq0QV0W7vjrJ9snEFZTJ235/IL1eUdUTo80r4u6wGyIbuiqFuj+oekK9NlahHyizsxVRQGZ86TeYDK/xRsfJJLw==',key_name='tempest-keypair-930182833',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50238fe1407541f28120b08a92300102',ramdisk_id='',reservation_id='r-5kalh1m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-830602594',owner_user_name='tempest-ServerActionsTestOtherB-830602594-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='838764a12310402d937f67bea06bbf70',uuid=d4465989-c669-4edd-b7d2-f71e203b7142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1374561824-network", "vif_mac": "fa:16:3e:c6:fe:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converting VIF {"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1374561824-network", "vif_mac": "fa:16:3e:c6:fe:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_vif [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap587cbad5-3a, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43512ca0-4c2d-41c8-ae51-16c5ca7f7d1d) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:19 user nova-compute[75703]: INFO os_vif [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a')
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOBwRxon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:47:19 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[71761dd1-f49d-4088-a8f2-f303b1b42258]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:47:19 user nova-compute[75703]: No targets found.
Nov 10 14:47:19 user nova-compute[75703]: iSNS:
Nov 10 14:47:19 user nova-compute[75703]: No targets found.
Nov 10 14:47:19 user nova-compute[75703]: STATIC:
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4
Nov 10 14:47:19 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:19 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:19 user nova-compute[75703]: FIRMWARE:
Nov 10 14:47:19 user nova-compute[75703]: No targets found.
Nov 10 14:47:19 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:47:19 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:47:19 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b8b81-11eb-41da-8c17-c9fd351e807b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e3d80-5cf3-46ea-baa6-f9448650bf86]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:19 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a472eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e15d198-73f7-4296-a946-ff5b9804fcc6]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b97ec-1140-43ab-a0ea-be73b9438811]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10be17-c9ff-4b83-9e16-99f5ead57a96]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[77105535-297d-4625-a28c-bd8ba44c392e]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5658b76-3095-446c-946d-4431a581b64e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed82f64-170b-46cf-88aa-b9e4b3dea020]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260]
Nov 10 14:47:19 user nova-compute[75703]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150, portal: 172.16.0.220,3260] successful.
Nov 10 14:47:19 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f1fb9e-a861-4da7-b38f-c01994cad724]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] <== disconnect_volume: return (314ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-vif-unplugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] No waiting events found dispatching network-vif-unplugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:19 user nova-compute[75703]: WARNING nova.compute.manager [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received unexpected event network-vif-unplugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be for instance with vm_state active and task_state resize_migrating.
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] No waiting events found dispatching network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:19 user nova-compute[75703]: WARNING nova.compute.manager [req-60ce31dc-01fc-4bde-bb1a-cfef58db10d7 req-05a0791c-ceaa-41ce-8887-c92bc2478f95 service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received unexpected event network-vif-plugged-587cbad5-3ac6-4adf-ad70-7e2d0268e4be for instance with vm_state active and task_state resize_migrating.
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:47:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize/disk /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "cp -r /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize/disk /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk" returned: 0 in 0.377s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize/disk.info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk.info {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] CMD "cp -r /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize/disk.info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk.info" returned: 0 in 0.039s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Port 587cbad5-3ac6-4adf-ad70-7e2d0268e4be binding to destination host user is already ACTIVE {{(pid=75703) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquired lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [{"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Releasing lock "refresh_cache-d4465989-c669-4edd-b7d2-f71e203b7142" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG os_brick.utils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03fdadb-72dc-41eb-8dd3-79d6f8ad7e1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a6650f-0a7b-46d0-bc3f-f9ea6c5f30e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[04af65f8-46d5-442d-8622-56d84c0ec43e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0f51e-e0ad-4649-bdff-0e3d55d2c0b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:47:22 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:47:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd0ff9-89d3-48df-b272-c7dc9708d73b]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:47:22 user nova-compute[75703]: DEBUG os_brick.utils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:47:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-changed-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing instance network info cache due to event network-changed-86926a35-7954-4ff2-8ff8-45f3252e9251. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:47:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] Acquiring lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] Acquired lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Refreshing network info cache for port 86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:47:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updated VIF entry in instance network info cache for port 86926a35-7954-4ff2-8ff8-45f3252e9251. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:47:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-affa3cdf-a7f3-48f0-bf8b-6940eac09131 req-eb23c87e-e29d-46a9-9ebf-c9c2349815d6 service nova] Releasing lock "refresh_cache-571c71fd-4b7b-40b5-a728-be8b30580da5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:39 user nova-compute[75703]: INFO nova.compute.manager [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Terminating instance
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-c1d2464e-1069-4157-a9ec-c8cc134c8381 req-217d7e38-d213-40b4-887d-6381384fc3e9 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c1d2464e-1069-4157-a9ec-c8cc134c8381 req-217d7e38-d213-40b4-887d-6381384fc3e9 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c1d2464e-1069-4157-a9ec-c8cc134c8381 req-217d7e38-d213-40b4-887d-6381384fc3e9 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c1d2464e-1069-4157-a9ec-c8cc134c8381 req-217d7e38-d213-40b4-887d-6381384fc3e9 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-c1d2464e-1069-4157-a9ec-c8cc134c8381 req-217d7e38-d213-40b4-887d-6381384fc3e9 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-c1d2464e-1069-4157-a9ec-c8cc134c8381 req-217d7e38-d213-40b4-887d-6381384fc3e9 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-86926a35-7954-4ff2-8ff8-45f3252e9251 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-aeba42af-b781-4930-bbc2-db8c24a15e30 req-3494dd76-5415-4d86-9268-75150e18759e service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aeba42af-b781-4930-bbc2-db8c24a15e30 req-3494dd76-5415-4d86-9268-75150e18759e service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aeba42af-b781-4930-bbc2-db8c24a15e30 req-3494dd76-5415-4d86-9268-75150e18759e service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aeba42af-b781-4930-bbc2-db8c24a15e30 req-3494dd76-5415-4d86-9268-75150e18759e service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-aeba42af-b781-4930-bbc2-db8c24a15e30 req-3494dd76-5415-4d86-9268-75150e18759e service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-aeba42af-b781-4930-bbc2-db8c24a15e30 req-3494dd76-5415-4d86-9268-75150e18759e service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e504617-4f0c-4cdc-a338-dd0a8c5bd008 req-a5c205eb-d288-46f9-bf91-ea07381ad669 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e504617-4f0c-4cdc-a338-dd0a8c5bd008 req-a5c205eb-d288-46f9-bf91-ea07381ad669 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e504617-4f0c-4cdc-a338-dd0a8c5bd008 req-a5c205eb-d288-46f9-bf91-ea07381ad669 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e504617-4f0c-4cdc-a338-dd0a8c5bd008 req-a5c205eb-d288-46f9-bf91-ea07381ad669 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e504617-4f0c-4cdc-a338-dd0a8c5bd008 req-a5c205eb-d288-46f9-bf91-ea07381ad669 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e504617-4f0c-4cdc-a338-dd0a8c5bd008 req-a5c205eb-d288-46f9-bf91-ea07381ad669 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:40 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Instance destroyed successfully.
Nov 10 14:47:40 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lazy-loading 'resources' on Instance uuid 571c71fd-4b7b-40b5-a728-be8b30580da5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86926a35-79, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a70a4d95-6376-4d53-beec-fdf18c1a46e6) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:4c:75,bridge_name='br-int',has_traffic_filtering=True,id=86926a35-7954-4ff2-8ff8-45f3252e9251,network=Network(e61fae37-adda-447e-a223-8d4873d0820e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86926a35-79')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12fbc1f1-12, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a7c7aa5-cfae-4f21-b434-43ee5a9bd90d) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:26:87,bridge_name='br-int',has_traffic_filtering=True,id=12fbc1f1-12f6-4821-8a08-dbb4c5c384c3,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12fbc1f1-12')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8f4b90a-cf, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a12db5d-b14e-43d6-9de9-5bf9fbe58e3f) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:16:e0,bridge_name='br-int',has_traffic_filtering=True,id=f8f4b90a-cf48-4bbe-bd55-868e5893ae04,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf8f4b90a-cf')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "address": "fa:16:3e:e3:54:66", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape416f060-9c", "ovs_interfaceid": "e416f060-9c1e-4b38-8dd2-5999b8e1fd0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape416f060-9c, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=346cb368-9037-42d7-813a-86a6de28b107) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:54:66,bridge_name='br-int',has_traffic_filtering=True,id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape416f060-9c')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap376356e9-1d, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=302806c4-a66c-4c05-856d-73d1b8b65e9a) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-86926a35-7954-4ff2-8ff8-45f3252e9251 for instance with vm_state active and task_state deleting.
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-f8f4b90a-cf48-4bbe-bd55-868e5893ae04 for instance with vm_state active and task_state deleting.
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b for instance with vm_state active and task_state deleting.
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-1cd61549-3867-4279-842a-38dbfa9669f8 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING nova.compute.manager [req-2c37709f-f998-4115-b3c0-b4529568bad0 req-1177d956-7ae4-4e53-8e78-83ccbd0c6d56 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-1cd61549-3867-4279-842a-38dbfa9669f8 for instance with vm_state active and task_state deleting.
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:02:bf,bridge_name='br-int',has_traffic_filtering=True,id=376356e9-1d11-4a3b-a897-3f8442b1ba3c,network=Network(6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376356e9-1d')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6927009b-f3, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b31f3f91-27a2-4717-ba3b-891a5bcaf3c2) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:69:91,bridge_name='br-int',has_traffic_filtering=True,id=6927009b-f303-4652-8a2c-7aa4ca693b8f,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927009b-f3')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962779522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962779522',id=11,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtaWhDeIGNGGNQGxfnVRsnMbcxZK7HIJrbK+cAc3swGLo2a6p14Kaxc20GFTmKxYScnf1wOPV/519GeDTk+bH8Kh5hAfTYhpSb63eBaxly1OmYLj7YeMCyQtv2xudTAaw==',key_name='tempest-keypair-809602522',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f573a2d67c9949e2bae56d01a5ef5e49',ramdisk_id='',reservation_id='r-v0znkfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1616361045',owner_user_name='tempest-TaggedBootDevicesTest-1616361045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d23035d70a214b86a7717fd3031e6a5a',uuid=571c71fd-4b7b-40b5-a728-be8b30580da5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converting VIF {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cd61549-38, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dddae33-7654-4b19-a548-390fc313a2c5) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:41 user nova-compute[75703]: INFO os_vif [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:02:b5,bridge_name='br-int',has_traffic_filtering=True,id=1cd61549-3867-4279-842a-38dbfa9669f8,network=Network(cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd61549-38')
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgmiSjkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-12fbc1f1-12f6-4821-8a08-dbb4c5c384c3 for instance with vm_state active and task_state deleting.
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-unplugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-unplugged-6927009b-f303-4652-8a2c-7aa4ca693b8f for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b6a92b9d-bde2-4492-9405-1170b7717ed8 req-4ceb5ff6-fc6c-42f4-939f-0d0675731c4a service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-6927009b-f303-4652-8a2c-7aa4ca693b8f for instance with vm_state active and task_state deleting.
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e173a4-751b-4afe-bf03-076c443ff31d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:47:41 user nova-compute[75703]: No targets found.
Nov 10 14:47:41 user nova-compute[75703]: iSNS:
Nov 10 14:47:41 user nova-compute[75703]: No targets found.
Nov 10 14:47:41 user nova-compute[75703]: STATIC:
Nov 10 14:47:41 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:47:41 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:41 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:41 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:47:41 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:41 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:41 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:47:41 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:41 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:41 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:47:41 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:41 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:41 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:47:41 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:41 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:41 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4
Nov 10 14:47:41 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:41 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:41 user nova-compute[75703]: FIRMWARE:
Nov 10 14:47:41 user nova-compute[75703]: No targets found.
Nov 10 14:47:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:47:41 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:47:41 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b5b35c-39ed-463d-bc74-396421aea290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[88194b2a-77e6-4bc7-8d3a-e840fad9ea9f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a42831c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4'): ({'sdf'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Removing single pathed devices sdf {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19f09da-9dcb-4e24-99b0-e0182e53641e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3492a38-ec29-46bc-bc7a-83ff616d1b35]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Flushing IO for device /dev/sdf {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[480934a4-cb3f-4bc7-8628-df235975d0a2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa994224-a7f2-4d19-aa27-246a98405c77]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] SCSI volumes sdf have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69c8d5-b361-4894-a0b6-a92c530dab6d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9140e1-0298-4038-ae74-c550d96bcc49]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260]
Nov 10 14:47:41 user nova-compute[75703]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4, portal: 172.16.0.220,3260] successful.
Nov 10 14:47:41 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6a9681-ad81-4f01-b014-1462c614b6f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e958df0-bded-4ec1-aea4-aa68f8a58631]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== disconnect_volume: return (403ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YATqxrfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:47:42 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[30de7a1d-29e0-4b3c-95fc-984a62124869]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:47:42 user nova-compute[75703]: No targets found.
Nov 10 14:47:42 user nova-compute[75703]: iSNS:
Nov 10 14:47:42 user nova-compute[75703]: No targets found.
Nov 10 14:47:42 user nova-compute[75703]: STATIC:
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: FIRMWARE:
Nov 10 14:47:42 user nova-compute[75703]: No targets found.
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:47:42 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:47:42 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-bca303d0-b581-4ae4-9a36-73c91e2970fb req-40fa9c8e-42ac-4621-9194-a9742b0a4260 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bca303d0-b581-4ae4-9a36-73c91e2970fb req-40fa9c8e-42ac-4621-9194-a9742b0a4260 service nova] Acquiring lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bca303d0-b581-4ae4-9a36-73c91e2970fb req-40fa9c8e-42ac-4621-9194-a9742b0a4260 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bca303d0-b581-4ae4-9a36-73c91e2970fb req-40fa9c8e-42ac-4621-9194-a9742b0a4260 service nova] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-bca303d0-b581-4ae4-9a36-73c91e2970fb req-40fa9c8e-42ac-4621-9194-a9742b0a4260 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] No waiting events found dispatching network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:42 user nova-compute[75703]: WARNING nova.compute.manager [req-bca303d0-b581-4ae4-9a36-73c91e2970fb req-40fa9c8e-42ac-4621-9194-a9742b0a4260 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received unexpected event network-vif-plugged-376356e9-1d11-4a3b-a897-3f8442b1ba3c for instance with vm_state active and task_state deleting.
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f6f929-2b2d-4061-ac98-99a620ec7c03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705b926-5f40-40aa-8ff1-943b417d9d53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4740c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4'): ({'sdg'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Removing single pathed devices sdg {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ffecfe-58e3-4600-9e4c-3d32754adba6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9c09f7-c6fd-435c-a33b-74540128f2ef]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Flushing IO for device /dev/sdg {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[acca2c84-1aad-48dd-910f-ac7312b3d3bb]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fbe35c-173c-47ec-82c2-891b07525477]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] SCSI volumes sdg have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4e42a-6b69-4510-af91-239bbac1b14a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7721979-ff10-4729-b026-bfa385d51a4d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260]
Nov 10 14:47:42 user nova-compute[75703]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4, portal: 172.16.0.220,3260] successful.
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be94a23c-71a0-4038-b3ab-e6cbc390a4f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecffc8-2509-431d-a79b-e014ff96675a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== disconnect_volume: return (344ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoIVuXaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:47:42 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[82684f86-b150-4126-bed4-3cd55bbc41fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:47:42 user nova-compute[75703]: No targets found.
Nov 10 14:47:42 user nova-compute[75703]: iSNS:
Nov 10 14:47:42 user nova-compute[75703]: No targets found.
Nov 10 14:47:42 user nova-compute[75703]: STATIC:
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:47:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:47:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:47:42 user nova-compute[75703]: FIRMWARE:
Nov 10 14:47:42 user nova-compute[75703]: No targets found.
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:47:42 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:47:42 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c62b738-70c4-4823-957d-b6a035554c28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5aa254-c8f8-44d2-895f-a5286c160485]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:47:42 user nova-compute[75703]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 (non-flash)
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4740c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009'): ({'sdh'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Removing single pathed devices sdh {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ebfee2-8b85-4818-9ed3-c8283b2ef6d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e248bf8-1ac7-4ee1-8751-f4b268002a63]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Flushing IO for device /dev/sdh {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d855e-bdf8-48c3-8c80-dcfbb723b3b8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd2dc69-9e27-477a-9456-7e3881d5acf8]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] SCSI volumes sdh have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9c097e-530b-425a-8067-dfb5f1a92453]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[761940e6-793b-4d2d-b9de-189bba5fbc2e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260]
Nov 10 14:47:42 user nova-compute[75703]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009, portal: 172.16.0.220,3260] successful.
Nov 10 14:47:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab0b5918-c0dd-47cc-ad64-c8ff5457a009 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb79db9-029c-4310-bd6b-45f35ede359a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] <== disconnect_volume: return (333ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:47:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Deleting instance files /opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5_del
Nov 10 14:47:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Deletion of /opt/stack/data/nova/instances/571c71fd-4b7b-40b5-a728-be8b30580da5_del complete
Nov 10 14:47:42 user nova-compute[75703]: INFO nova.compute.manager [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Took 3.65 seconds to destroy the instance on the hypervisor.
Nov 10 14:47:42 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:47:42 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:47:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-fdfd7c1e-90e0-428e-a334-f8e38a5f8f75 req-46f3975a-399b-461e-ac93-2a8732a0a027 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-deleted-e416f060-9c1e-4b38-8dd2-5999b8e1fd0b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:44 user nova-compute[75703]: INFO nova.compute.manager [req-fdfd7c1e-90e0-428e-a334-f8e38a5f8f75 req-46f3975a-399b-461e-ac93-2a8732a0a027 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Neutron deleted interface e416f060-9c1e-4b38-8dd2-5999b8e1fd0b; detaching it from the instance and deleting it from the info cache
Nov 10 14:47:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-fdfd7c1e-90e0-428e-a334-f8e38a5f8f75 req-46f3975a-399b-461e-ac93-2a8732a0a027 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [{"id": "86926a35-7954-4ff2-8ff8-45f3252e9251", "address": "fa:16:3e:50:4c:75", "network": {"id": "e61fae37-adda-447e-a223-8d4873d0820e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-592649154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86926a35-79", "ovs_interfaceid": "86926a35-7954-4ff2-8ff8-45f3252e9251", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "address": "fa:16:3e:e9:26:87", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12fbc1f1-12", "ovs_interfaceid": "12fbc1f1-12f6-4821-8a08-dbb4c5c384c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "address": "fa:16:3e:0a:16:e0", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f4b90a-cf", "ovs_interfaceid": "f8f4b90a-cf48-4bbe-bd55-868e5893ae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "address": "fa:16:3e:96:02:bf", "network": {"id": "6ac1a9a0-3e2c-451a-91b0-cf2cf8c4e25f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813237016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376356e9-1d", "ovs_interfaceid": "376356e9-1d11-4a3b-a897-3f8442b1ba3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "address": "fa:16:3e:66:69:91", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927009b-f3", "ovs_interfaceid": "6927009b-f303-4652-8a2c-7aa4ca693b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cd61549-3867-4279-842a-38dbfa9669f8", "address": "fa:16:3e:e6:02:b5", "network": {"id": "cbf04fdc-6b8c-4e88-b047-3aa64c4b0e05", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246406434", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f573a2d67c9949e2bae56d01a5ef5e49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd61549-38", "ovs_interfaceid": "1cd61549-3867-4279-842a-38dbfa9669f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-fdfd7c1e-90e0-428e-a334-f8e38a5f8f75 req-46f3975a-399b-461e-ac93-2a8732a0a027 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Detach interface failed, port_id=e416f060-9c1e-4b38-8dd2-5999b8e1fd0b, reason: Instance 571c71fd-4b7b-40b5-a728-be8b30580da5 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:47:45 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:46 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Took 3.23 seconds to deallocate network for instance.
Nov 10 14:47:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f22eeaf-4e7a-42de-90a3-a3c73ba6e814 req-fe8131f3-3675-4991-892a-b1f1a4c67687 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-deleted-6927009b-f303-4652-8a2c-7aa4ca693b8f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f22eeaf-4e7a-42de-90a3-a3c73ba6e814 req-fe8131f3-3675-4991-892a-b1f1a4c67687 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-deleted-376356e9-1d11-4a3b-a897-3f8442b1ba3c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f22eeaf-4e7a-42de-90a3-a3c73ba6e814 req-fe8131f3-3675-4991-892a-b1f1a4c67687 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-deleted-86926a35-7954-4ff2-8ff8-45f3252e9251 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f22eeaf-4e7a-42de-90a3-a3c73ba6e814 req-fe8131f3-3675-4991-892a-b1f1a4c67687 service nova] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Received event network-vif-deleted-1cd61549-3867-4279-842a-38dbfa9669f8 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:47:47 user nova-compute[75703]: INFO nova.compute.claims [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Claim successful on node user
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.volume.cinder [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Update attachment failed for attachment 565bf6b7-d8c5-4750-8a22-c0a67fb420b0. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e99c44d5-e1e9-4e9c-b529-e6deb8459cb4) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e99c44d5-e1e9-4e9c-b529-e6deb8459cb4)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e99c44d5-e1e9-4e9c-b529-e6deb8459cb4)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Traceback (most recent call last):
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     yield
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     network_info = self._finish_resize(context, instance, migration,
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     self._update_volume_attachments(context, instance, bdms)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     self.volume_api.attachment_update(
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     res = method(self, ctx, *args, **kwargs)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     with excutils.save_and_reraise_exception():
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     self.force_reraise()
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     raise self.value
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     return method.func(obj, *args, **kwargs)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     return self.request(url, method, **kwargs)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142]     raise exceptions.from_response(resp, body)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e99c44d5-e1e9-4e9c-b529-e6deb8459cb4)
Nov 10 14:47:47 user nova-compute[75703]: ERROR nova.compute.manager [instance: d4465989-c669-4edd-b7d2-f71e203b7142] 
Nov 10 14:47:47 user nova-compute[75703]: INFO nova.compute.manager [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Nov 10 14:47:47 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Deleted allocation for migration 6f8a93a9-e501-4887-8129-01b16277ba06
Nov 10 14:47:47 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:47:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.policy [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a55f2945837465eb94a73d1399b52e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad107feaed514542a6e5e91073ed48f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:47:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Creating image(s)
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "/opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "/opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:48 user nova-compute[75703]: INFO nova.compute.manager [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Successfully reverted task state from resize_finish on failure for instance.
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server [None req-44543578-66fd-4c7c-9821-c136ccaeb017 tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e99c44d5-e1e9-4e9c-b529-e6deb8459cb4)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6348, in finish_resize
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6345, in finish_resize
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e99c44d5-e1e9-4e9c-b529-e6deb8459cb4)
Nov 10 14:47:48 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk 1073741824" returned: 0 in 0.071s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Successfully created port: 3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:47:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Cannot resize image /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Ensure instance console log exists: /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Successfully updated port: 3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "refresh_cache-4b7d2537-14fb-4e00-919e-7cd132f46d8e" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquired lock "refresh_cache-4b7d2537-14fb-4e00-919e-7cd132f46d8e" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-changed-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Refreshing instance network info cache due to event network-changed-3a0a77a9-6cdd-4d85-a619-90221fb8cf68. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] Acquiring lock "refresh_cache-4b7d2537-14fb-4e00-919e-7cd132f46d8e" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Updating instance_info_cache with network_info: [{"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Releasing lock "refresh_cache-4b7d2537-14fb-4e00-919e-7cd132f46d8e" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Instance network_info: |[{"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] Acquired lock "refresh_cache-4b7d2537-14fb-4e00-919e-7cd132f46d8e" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.neutron [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Refreshing network info cache for port 3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Start _get_guest_xml network_info=[{"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:47:49 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:47:49 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-655670132',display_name='tempest-VolumesAdminNegativeTest-server-655670132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-655670132',id=15,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad107feaed514542a6e5e91073ed48f0',ramdisk_id='',reservation_id='r-140qtopj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18732562',owner_user_name='tempest-VolumesAdminNegativeTest-18732562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:47:48Z,user_data=None,user_id='9a55f2945837465eb94a73d1399b52e8',uuid=4b7d2537-14fb-4e00-919e-7cd132f46d8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converting VIF {"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b7d2537-14fb-4e00-919e-7cd132f46d8e {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:47:49 user nova-compute[75703]:   <uuid>4b7d2537-14fb-4e00-919e-7cd132f46d8e</uuid>
Nov 10 14:47:49 user nova-compute[75703]:   <name>instance-0000000f</name>
Nov 10 14:47:49 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:47:49 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:47:49 user nova-compute[75703]:   <metadata>
Nov 10 14:47:49 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:47:49 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:47:49 user nova-compute[75703]:       <nova:name>tempest-VolumesAdminNegativeTest-server-655670132</nova:name>
Nov 10 14:47:49 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:47:49</nova:creationTime>
Nov 10 14:47:49 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:47:49 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:47:49 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:47:49 user nova-compute[75703]:       <nova:owner>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:user uuid="9a55f2945837465eb94a73d1399b52e8">tempest-VolumesAdminNegativeTest-18732562-project-member</nova:user>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:project uuid="ad107feaed514542a6e5e91073ed48f0">tempest-VolumesAdminNegativeTest-18732562</nova:project>
Nov 10 14:47:49 user nova-compute[75703]:       </nova:owner>
Nov 10 14:47:49 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:47:49 user nova-compute[75703]:       <nova:ports>
Nov 10 14:47:49 user nova-compute[75703]:         <nova:port uuid="3a0a77a9-6cdd-4d85-a619-90221fb8cf68">
Nov 10 14:47:49 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 14:47:49 user nova-compute[75703]:         </nova:port>
Nov 10 14:47:49 user nova-compute[75703]:       </nova:ports>
Nov 10 14:47:49 user nova-compute[75703]:     </nova:instance>
Nov 10 14:47:49 user nova-compute[75703]:   </metadata>
Nov 10 14:47:49 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:47:49 user nova-compute[75703]:     <system>
Nov 10 14:47:49 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:47:49 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:47:49 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:47:49 user nova-compute[75703]:       <entry name="serial">4b7d2537-14fb-4e00-919e-7cd132f46d8e</entry>
Nov 10 14:47:49 user nova-compute[75703]:       <entry name="uuid">4b7d2537-14fb-4e00-919e-7cd132f46d8e</entry>
Nov 10 14:47:49 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:47:49 user nova-compute[75703]:     </system>
Nov 10 14:47:49 user nova-compute[75703]:   </sysinfo>
Nov 10 14:47:49 user nova-compute[75703]:   <os>
Nov 10 14:47:49 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:47:49 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:47:49 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:47:49 user nova-compute[75703]:   </os>
Nov 10 14:47:49 user nova-compute[75703]:   <features>
Nov 10 14:47:49 user nova-compute[75703]:     <acpi/>
Nov 10 14:47:49 user nova-compute[75703]:     <apic/>
Nov 10 14:47:49 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:47:49 user nova-compute[75703]:   </features>
Nov 10 14:47:49 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:47:49 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:47:49 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:47:49 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:47:49 user nova-compute[75703]:   </clock>
Nov 10 14:47:49 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:47:49 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:47:49 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:47:49 user nova-compute[75703]:   </cpu>
Nov 10 14:47:49 user nova-compute[75703]:   <devices>
Nov 10 14:47:49 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:47:49 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:47:49 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk"/>
Nov 10 14:47:49 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:47:49 user nova-compute[75703]:     </disk>
Nov 10 14:47:49 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:47:49 user nova-compute[75703]:       <mac address="fa:16:3e:aa:53:f9"/>
Nov 10 14:47:49 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:47:49 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:47:49 user nova-compute[75703]:       <target dev="tap3a0a77a9-6c"/>
Nov 10 14:47:49 user nova-compute[75703]:     </interface>
Nov 10 14:47:49 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:47:49 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/console.log" append="off"/>
Nov 10 14:47:49 user nova-compute[75703]:     </serial>
Nov 10 14:47:49 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:47:49 user nova-compute[75703]:     <video>
Nov 10 14:47:49 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:47:49 user nova-compute[75703]:     </video>
Nov 10 14:47:49 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:47:49 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:47:49 user nova-compute[75703]:     </rng>
Nov 10 14:47:49 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:47:49 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:47:49 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:47:49 user nova-compute[75703]:     </memballoon>
Nov 10 14:47:49 user nova-compute[75703]:   </devices>
Nov 10 14:47:49 user nova-compute[75703]: </domain>
Nov 10 14:47:49 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-655670132',display_name='tempest-VolumesAdminNegativeTest-server-655670132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-655670132',id=15,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad107feaed514542a6e5e91073ed48f0',ramdisk_id='',reservation_id='r-140qtopj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18732562',owner_user_name='tempest-VolumesAdminNegativeTest-18732562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:47:48Z,user_data=None,user_id='9a55f2945837465eb94a73d1399b52e8',uuid=4b7d2537-14fb-4e00-919e-7cd132f46d8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converting VIF {"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG os_vif [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b4d011f-4b02-5aaa-a3c1-84bfbda6aec9', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a0a77a9-6c, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a0a77a9-6c, col_values=(('qos', UUID('7e68e774-e3ff-4086-b81a-8a9857d6d6e8')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a0a77a9-6c, col_values=(('external_ids', {'iface-id': '3a0a77a9-6cdd-4d85-a619-90221fb8cf68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:53:f9', 'vm-uuid': '4b7d2537-14fb-4e00-919e-7cd132f46d8e'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:50 user nova-compute[75703]: INFO os_vif [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c')
Nov 10 14:47:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] No VIF found with MAC fa:16:3e:aa:53:f9, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Updated VIF entry in instance network info cache for port 3a0a77a9-6cdd-4d85-a619-90221fb8cf68. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Updating instance_info_cache with network_info: [{"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-eb8e443a-7a96-498b-8190-0df13ada8f87 req-995bb157-3f8a-40ff-a636-ed33483e7169 service nova] Releasing lock "refresh_cache-4b7d2537-14fb-4e00-919e-7cd132f46d8e" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 14:47:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 0 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-90618d7b-38b1-4fc9-a610-637402e99abf req-953f27b6-205d-4c7b-9329-791e13433067 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-90618d7b-38b1-4fc9-a610-637402e99abf req-953f27b6-205d-4c7b-9329-791e13433067 service nova] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-90618d7b-38b1-4fc9-a610-637402e99abf req-953f27b6-205d-4c7b-9329-791e13433067 service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-90618d7b-38b1-4fc9-a610-637402e99abf req-953f27b6-205d-4c7b-9329-791e13433067 service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-90618d7b-38b1-4fc9-a610-637402e99abf req-953f27b6-205d-4c7b-9329-791e13433067 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] No waiting events found dispatching network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:51 user nova-compute[75703]: WARNING nova.compute.manager [req-90618d7b-38b1-4fc9-a610-637402e99abf req-953f27b6-205d-4c7b-9329-791e13433067 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received unexpected event network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 for instance with vm_state building and task_state spawning.
Nov 10 14:47:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:47:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Instance spawned successfully.
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:47:53 user nova-compute[75703]: INFO nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-03e21ad2-13c7-431f-a1b8-4c0532e73853 req-86b173fb-267c-4b1a-805a-3b45a6ee96f6 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-03e21ad2-13c7-431f-a1b8-4c0532e73853 req-86b173fb-267c-4b1a-805a-3b45a6ee96f6 service nova] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-03e21ad2-13c7-431f-a1b8-4c0532e73853 req-86b173fb-267c-4b1a-805a-3b45a6ee96f6 service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-03e21ad2-13c7-431f-a1b8-4c0532e73853 req-86b173fb-267c-4b1a-805a-3b45a6ee96f6 service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-03e21ad2-13c7-431f-a1b8-4c0532e73853 req-86b173fb-267c-4b1a-805a-3b45a6ee96f6 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] No waiting events found dispatching network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:47:53 user nova-compute[75703]: WARNING nova.compute.manager [req-03e21ad2-13c7-431f-a1b8-4c0532e73853 req-86b173fb-267c-4b1a-805a-3b45a6ee96f6 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received unexpected event network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 for instance with vm_state building and task_state spawning.
Nov 10 14:47:53 user nova-compute[75703]: INFO nova.compute.manager [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Took 6.33 seconds to build instance.
Nov 10 14:47:53 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:47:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0ada1f5c-4116-4028-9bd1-42f543fac330 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:55 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:56 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:47:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:47:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:47:56 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:47:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updating instance_info_cache with network_info: [{"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:47:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-edc4e407-e824-4ee7-831b-fe0bf2ac4293" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:47:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:47:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:47:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "b9927f87-7338-4b59-a675-d122ff035659" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:47:59 user nova-compute[75703]: INFO nova.compute.manager [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Terminating instance
Nov 10 14:47:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:47:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ff0683d-c33a-4e8e-a41f-f7dc54a3d71e req-ac6a3863-513c-4eb7-9349-b3603fb9af28 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-vif-unplugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ff0683d-c33a-4e8e-a41f-f7dc54a3d71e req-ac6a3863-513c-4eb7-9349-b3603fb9af28 service nova] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ff0683d-c33a-4e8e-a41f-f7dc54a3d71e req-ac6a3863-513c-4eb7-9349-b3603fb9af28 service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ff0683d-c33a-4e8e-a41f-f7dc54a3d71e req-ac6a3863-513c-4eb7-9349-b3603fb9af28 service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ff0683d-c33a-4e8e-a41f-f7dc54a3d71e req-ac6a3863-513c-4eb7-9349-b3603fb9af28 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] No waiting events found dispatching network-vif-unplugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ff0683d-c33a-4e8e-a41f-f7dc54a3d71e req-ac6a3863-513c-4eb7-9349-b3603fb9af28 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-vif-unplugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:00 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b9927f87-7338-4b59-a675-d122ff035659] Instance destroyed successfully.
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.objects.instance [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lazy-loading 'resources' on Instance uuid b9927f87-7338-4b59-a675-d122ff035659 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-605647709',display_name='tempest-VolumesAssistedSnapshotsTest-server-605647709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-605647709',id=9,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt9PSdNzidBgsqefKZvvc/mCyAWpMTfgvuESoHuFaPhlueOBdmm8RRUtG5J20WwqbqOqj02AJY6nh3DDCgiho+z5jZQZWU/bXQqUWsoAHqoqgoyzsM83JQIckJiHOf2uQ==',key_name='tempest-keypair-1299799377',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='820d77927bb544368ff872e15ca7a1ad',ramdisk_id='',reservation_id='r-2nvytatg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-408670870',owner_user_name='tempest-VolumesAssistedSnapshotsTest-408670870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4679e45903204f1b8df84225f1300644',uuid=b9927f87-7338-4b59-a675-d122ff035659,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Converting VIF {"id": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "address": "fa:16:3e:01:9b:a7", "network": {"id": "4df66eeb-826c-48ef-b4b5-d4adadd3b99d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1966675701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "820d77927bb544368ff872e15ca7a1ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd786df92-1b", "ovs_interfaceid": "d786df92-1b4e-4d6f-84da-9e5ac39a57a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG os_vif [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd786df92-1b, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a7918f2-852c-4e38-862b-ff678f3aa3e7) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:48:00 user nova-compute[75703]: INFO os_vif [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:9b:a7,bridge_name='br-int',has_traffic_filtering=True,id=d786df92-1b4e-4d6f-84da-9e5ac39a57a9,network=Network(4df66eeb-826c-48ef-b4b5-d4adadd3b99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd786df92-1b')
Nov 10 14:48:00 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Deleting instance files /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659_del
Nov 10 14:48:00 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Deletion of /opt/stack/data/nova/instances/b9927f87-7338-4b59-a675-d122ff035659_del complete
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:00 user nova-compute[75703]: INFO nova.compute.manager [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] [instance: 571c71fd-4b7b-40b5-a728-be8b30580da5] Took 14.86 seconds to detach 3 volumes for instance.
Nov 10 14:48:00 user nova-compute[75703]: INFO nova.compute.manager [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] [instance: b9927f87-7338-4b59-a675-d122ff035659] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: b9927f87-7338-4b59-a675-d122ff035659] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b9927f87-7338-4b59-a675-d122ff035659] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:48:01 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid 'b9927f87-7338-4b59-a675-d122ff035659' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b9927f87-7338-4b59-a675-d122ff035659' (instance-00000009)
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b9927f87-7338-4b59-a675-d122ff035659] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:01 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: b9927f87-7338-4b59-a675-d122ff035659] Took 0.78 seconds to deallocate network for instance.
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.854s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.061s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:01 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Deleted allocations for instance 571c71fd-4b7b-40b5-a728-be8b30580da5
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a3865cc-4d2c-41f6-8e6c-d694a76859b2 tempest-TaggedBootDevicesTest-1616361045 tempest-TaggedBootDevicesTest-1616361045-project-member] Lock "571c71fd-4b7b-40b5-a728-be8b30580da5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.902s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] Acquiring lock "b9927f87-7338-4b59-a675-d122ff035659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] Lock "b9927f87-7338-4b59-a675-d122ff035659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] No waiting events found dispatching network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:02 user nova-compute[75703]: WARNING nova.compute.manager [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received unexpected event network-vif-plugged-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 for instance with vm_state deleted and task_state None.
Nov 10 14:48:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-fac6f224-3695-4925-9778-45f7e1c779ea req-ffef690a-a61f-4b83-ae39-6bb0c408c828 service nova] [instance: b9927f87-7338-4b59-a675-d122ff035659] Received event network-vif-deleted-d786df92-1b4e-4d6f-84da-9e5ac39a57a9 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:02 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Deleted allocations for instance b9927f87-7338-4b59-a675-d122ff035659
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b17920eb-8c66-4ef8-83ff-743b9cc6acb6 tempest-VolumesAssistedSnapshotsTest-408670870 tempest-VolumesAssistedSnapshotsTest-408670870-project-member] Lock "b9927f87-7338-4b59-a675-d122ff035659" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.623s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:03 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:48:03 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=25.174819946289062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Applying migration context for instance d4465989-c669-4edd-b7d2-f71e203b7142 as it has an incoming, in-progress migration 6f8a93a9-e501-4887-8129-01b16277ba06. Migration status is error {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=75703) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d4465989-c669-4edd-b7d2-f71e203b7142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 4b7d2537-14fb-4e00-919e-7cd132f46d8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 14:48:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:25 user nova-compute[75703]: INFO nova.compute.manager [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Terminating instance
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-56db01c7-a987-4790-b64d-bb86b9a0cef3 req-4130a262-c0a7-40cb-9e8b-a6eacf9f9baf service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-vif-unplugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-56db01c7-a987-4790-b64d-bb86b9a0cef3 req-4130a262-c0a7-40cb-9e8b-a6eacf9f9baf service nova] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-56db01c7-a987-4790-b64d-bb86b9a0cef3 req-4130a262-c0a7-40cb-9e8b-a6eacf9f9baf service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-56db01c7-a987-4790-b64d-bb86b9a0cef3 req-4130a262-c0a7-40cb-9e8b-a6eacf9f9baf service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-56db01c7-a987-4790-b64d-bb86b9a0cef3 req-4130a262-c0a7-40cb-9e8b-a6eacf9f9baf service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] No waiting events found dispatching network-vif-unplugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-56db01c7-a987-4790-b64d-bb86b9a0cef3 req-4130a262-c0a7-40cb-9e8b-a6eacf9f9baf service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-vif-unplugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Instance destroyed successfully.
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lazy-loading 'resources' on Instance uuid 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:46:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-864290804',display_name='tempest-VolumesActionsTest-instance-864290804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-864290804',id=13,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8285dd3b302e414ab1af7fe6a452eca4',ramdisk_id='',reservation_id='r-f4tlqad4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-482205440',owner_user_name='tempest-VolumesActionsTest-482205440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:46:44Z,user_data=None,user_id='ee49c0739fee4225b268b81a5a271abe',uuid=9b6d99b3-5d01-42f2-93ec-dc4398d30c3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converting VIF {"id": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "address": "fa:16:3e:06:9e:a5", "network": {"id": "4767ef6b-1092-4faa-b7ee-e08e9b6b03b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-173721027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8285dd3b302e414ab1af7fe6a452eca4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea0876-0d", "ovs_interfaceid": "b8ea0876-0de2-4278-9d84-80641b1d90f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG os_vif [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8ea0876-0d, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bf5b81a-5413-464b-bee5-502eeaaa8155) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:25 user nova-compute[75703]: INFO os_vif [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9e:a5,bridge_name='br-int',has_traffic_filtering=True,id=b8ea0876-0de2-4278-9d84-80641b1d90f5,network=Network(4767ef6b-1092-4faa-b7ee-e08e9b6b03b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ea0876-0d')
Nov 10 14:48:25 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Deleting instance files /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a_del
Nov 10 14:48:25 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Deletion of /opt/stack/data/nova/instances/9b6d99b3-5d01-42f2-93ec-dc4398d30c3a_del complete
Nov 10 14:48:25 user nova-compute[75703]: INFO nova.compute.manager [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 10 14:48:25 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:48:25 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:26 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Took 0.50 seconds to deallocate network for instance.
Nov 10 14:48:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-23d7aa26-d7ed-4cf8-a3f2-847b41fe1950 req-7a775cce-0987-4a6c-b142-c2d4c0f54952 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-vif-deleted-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:26 user nova-compute[75703]: INFO nova.compute.manager [req-23d7aa26-d7ed-4cf8-a3f2-847b41fe1950 req-7a775cce-0987-4a6c-b142-c2d4c0f54952 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Neutron deleted interface b8ea0876-0de2-4278-9d84-80641b1d90f5; detaching it from the instance and deleting it from the info cache
Nov 10 14:48:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-23d7aa26-d7ed-4cf8-a3f2-847b41fe1950 req-7a775cce-0987-4a6c-b142-c2d4c0f54952 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-23d7aa26-d7ed-4cf8-a3f2-847b41fe1950 req-7a775cce-0987-4a6c-b142-c2d4c0f54952 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Detach interface failed, port_id=b8ea0876-0de2-4278-9d84-80641b1d90f5, reason: Instance 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:48:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:26 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Deleted allocations for instance 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a
Nov 10 14:48:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8025ad61-a459-484c-9a43-86dda1c419c4 tempest-VolumesActionsTest-482205440 tempest-VolumesActionsTest-482205440-project-member] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07fff95-5570-45fa-9486-5c8ca0914dc9 req-b3cebee9-89be-476a-97f0-d1a3d31b7b99 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received event network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07fff95-5570-45fa-9486-5c8ca0914dc9 req-b3cebee9-89be-476a-97f0-d1a3d31b7b99 service nova] Acquiring lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07fff95-5570-45fa-9486-5c8ca0914dc9 req-b3cebee9-89be-476a-97f0-d1a3d31b7b99 service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07fff95-5570-45fa-9486-5c8ca0914dc9 req-b3cebee9-89be-476a-97f0-d1a3d31b7b99 service nova] Lock "9b6d99b3-5d01-42f2-93ec-dc4398d30c3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07fff95-5570-45fa-9486-5c8ca0914dc9 req-b3cebee9-89be-476a-97f0-d1a3d31b7b99 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] No waiting events found dispatching network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:27 user nova-compute[75703]: WARNING nova.compute.manager [req-b07fff95-5570-45fa-9486-5c8ca0914dc9 req-b3cebee9-89be-476a-97f0-d1a3d31b7b99 service nova] [instance: 9b6d99b3-5d01-42f2-93ec-dc4398d30c3a] Received unexpected event network-vif-plugged-b8ea0876-0de2-4278-9d84-80641b1d90f5 for instance with vm_state deleted and task_state None.
Nov 10 14:48:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:29 user nova-compute[75703]: INFO nova.compute.manager [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Rescuing
Nov 10 14:48:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:48:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:48:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-e7874ebe-1939-4bf0-aa9c-c8e375cae23a req-11fb3dad-c698-48e6-9af8-d93cb16d08e0 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e7874ebe-1939-4bf0-aa9c-c8e375cae23a req-11fb3dad-c698-48e6-9af8-d93cb16d08e0 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e7874ebe-1939-4bf0-aa9c-c8e375cae23a req-11fb3dad-c698-48e6-9af8-d93cb16d08e0 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e7874ebe-1939-4bf0-aa9c-c8e375cae23a req-11fb3dad-c698-48e6-9af8-d93cb16d08e0 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-e7874ebe-1939-4bf0-aa9c-c8e375cae23a req-11fb3dad-c698-48e6-9af8-d93cb16d08e0 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:30 user nova-compute[75703]: WARNING nova.compute.manager [req-e7874ebe-1939-4bf0-aa9c-c8e375cae23a req-11fb3dad-c698-48e6-9af8-d93cb16d08e0 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state active and task_state rescuing.
Nov 10 14:48:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance destroyed successfully.
Nov 10 14:48:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Attempting a stable device rescue
Nov 10 14:48:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75703) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 14:48:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 14:48:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Creating image(s)
Nov 10 14:48:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "c8b00128e0102a8ff9e05e875ef7a92475168f3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "c8b00128e0102a8ff9e05e875ef7a92475168f3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:32 user nova-compute[75703]: DEBUG nova.virt.images [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] 45583124-f926-4f0f-9a35-4f3885515193 was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:48:32 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:48:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.part /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.part /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.converted" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-91ce0082-a9af-46a0-85a5-710b6e94652e req-16d7800a-0638-477a-8413-53a46d15ff7d service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-91ce0082-a9af-46a0-85a5-710b6e94652e req-16d7800a-0638-477a-8413-53a46d15ff7d service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-91ce0082-a9af-46a0-85a5-710b6e94652e req-16d7800a-0638-477a-8413-53a46d15ff7d service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-91ce0082-a9af-46a0-85a5-710b6e94652e req-16d7800a-0638-477a-8413-53a46d15ff7d service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-91ce0082-a9af-46a0-85a5-710b6e94652e req-16d7800a-0638-477a-8413-53a46d15ff7d service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:33 user nova-compute[75703]: WARNING nova.compute.manager [req-91ce0082-a9af-46a0-85a5-710b6e94652e req-16d7800a-0638-477a-8413-53a46d15ff7d service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state active and task_state rescuing.
Nov 10 14:48:33 user nova-compute[75703]: INFO nova.compute.manager [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Unrescuing
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.network.neutron [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "c8b00128e0102a8ff9e05e875ef7a92475168f3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.724s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "c8b00128e0102a8ff9e05e875ef7a92475168f3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "c8b00128e0102a8ff9e05e875ef7a92475168f3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c,backing_fmt=raw /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c,backing_fmt=raw /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue" returned: 0 in 0.059s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "c8b00128e0102a8ff9e05e875ef7a92475168f3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'migration_context' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Start _get_guest_xml network_info=[{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "vif_mac": "fa:16:3e:f9:3f:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '45583124-f926-4f0f-9a35-4f3885515193', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '8b5e3d6a-8b69-4477-8717-4c9cabb2106f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15', 'attached_at': '', 'detached_at': '', 'volume_id': '20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'serial': '20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'resources' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:48:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:48:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:48:33 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:48:33 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:48:33 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.network.neutron [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba131df5-0093-49bf-a4e6-811718454ee3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fEtYmZRl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 14:48:33 user nova-compute[75703]: node.name = iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:48:33 user nova-compute[75703]: node.tpgt = -1
Nov 10 14:48:33 user nova-compute[75703]: node.startup = automatic
Nov 10 14:48:33 user nova-compute[75703]: node.leading_login = No
Nov 10 14:48:33 user nova-compute[75703]: iface.iscsi_ifacename = default
Nov 10 14:48:33 user nova-compute[75703]: iface.net_ifacename = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.ipaddress = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.prefix_len = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.hwaddress = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.transport_name = tcp
Nov 10 14:48:33 user nova-compute[75703]: iface.initiatorname = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.vlan_id = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.vlan_priority = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.vlan_state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.iface_num = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.mtu = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.port = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.bootproto = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.subnet_mask = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.gateway = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_alt_client_id = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_dns = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_learn_iqn = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_vendor_id_state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_vendor_id = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.dhcp_slp_da = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.fragmentation = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.gratuitous_arp = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.incoming_forwarding = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.tos_state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.tos = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.ttl = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.delayed_ack = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.tcp_nagle = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.tcp_wsf_state = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.tcp_wsf = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.tcp_timer_scale = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.tcp_timestamp = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.redirect = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.def_task_mgmt_timeout = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.header_digest = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.data_digest = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.immediate_data = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.initial_r2t = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.data_seq_inorder = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.data_pdu_inorder = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.erl = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.max_receive_data_len = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.first_burst_len = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.max_outstanding_r2t = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.max_burst_len = 0
Nov 10 14:48:33 user nova-compute[75703]: iface.chap_auth = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.bidi_chap = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.strict_login_compliance = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.discovery_auth = <empty>
Nov 10 14:48:33 user nova-compute[75703]: iface.discovery_logout = <empty>
Nov 10 14:48:33 user nova-compute[75703]: node.discovery_address = <empty>
Nov 10 14:48:33 user nova-compute[75703]: node.discovery_port = 0
Nov 10 14:48:33 user nova-compute[75703]: node.discovery_type = static
Nov 10 14:48:33 user nova-compute[75703]: node.session.initial_cmdsn = 0
Nov 10 14:48:33 user nova-compute[75703]: node.session.initial_login_retry_max = 8
Nov 10 14:48:33 user nova-compute[75703]: node.session.xmit_thread_priority = -20
Nov 10 14:48:33 user nova-compute[75703]: node.session.cmds_max = 128
Nov 10 14:48:33 user nova-compute[75703]: node.session.queue_depth = 32
Nov 10 14:48:33 user nova-compute[75703]: node.session.nr_sessions = 1
Nov 10 14:48:33 user nova-compute[75703]: node.session.auth.authmethod = CHAP
Nov 10 14:48:33 user nova-compute[75703]: node.session.auth.username = fEtYmZRl
Nov 10 14:48:33 user nova-compute[75703]: node.session.auth.password = ***
Nov 10 14:48:33 user nova-compute[75703]: node.session.auth.username_in = <empty>
Nov 10 14:48:33 user nova-compute[75703]: node.session.auth.password_in = <empty>
Nov 10 14:48:33 user nova-compute[75703]: node.session.auth.chap_algs = MD5
Nov 10 14:48:33 user nova-compute[75703]: node.session.timeo.replacement_timeout = 120
Nov 10 14:48:33 user nova-compute[75703]: node.session.err_timeo.abort_timeout = 15
Nov 10 14:48:33 user nova-compute[75703]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 14:48:33 user nova-compute[75703]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 14:48:33 user nova-compute[75703]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.FastAbort = Yes
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.InitialR2T = No
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.ImmediateData = Yes
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.MaxConnections = 1
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 14:48:33 user nova-compute[75703]: node.session.iscsi.ERL = 0
Nov 10 14:48:33 user nova-compute[75703]: node.session.scan = manual
Nov 10 14:48:33 user nova-compute[75703]: node.session.reopen_max = 0
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].address = 172.16.0.220
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].port = 3260
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].startup = manual
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].tcp.window_size = 524288
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].tcp.type_of_service = 0
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].timeo.logout_timeout = 15
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].timeo.login_timeout = 15
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].timeo.auth_timeout = 45
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].iscsi.DataDigest = None
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].iscsi.IFMarker = No
Nov 10 14:48:33 user nova-compute[75703]: node.conn[0].iscsi.OFMarker = No
Nov 10 14:48:33 user nova-compute[75703]: # END RECORD
Nov 10 14:48:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'flavor' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48f7bf0-c785-4534-ab18-8b5162e3bf85]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba7159-2479-47d4-a47b-ffe59b00be8b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEtYmZRl {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEtYmZRl" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f0d5e-5994-4444-9188-8850baf1a116]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fEtYmZRl'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c42126-a64b-4975-9be3-cfd92b440389]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3867fc0a-241c-4d04-93f1-ff37c5886494]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:48:33 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:48:33 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:48:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:48:33 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:48:33 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:48:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.182s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] HCTL ('42', '0', '0', 0) found on session 12 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Scanning host 42 c: 0, t: 0, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb406c6-7915-4ec1-a05d-af3cdf0ce028]: (4, ('0 0 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching for a device in session 12 and hctl ('42', '0', '0', 0) yield: sdk {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== connect_volume: return (215ms) {'type': 'block', 'scsi_wwn': '23338323665383862', 'path': '/dev/sdk'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338323665383862', 'path': '/dev/sdk'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:44:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1625523003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1625523003',id=12,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-u0in6oq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:46:47Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "vif_mac": "fa:16:3e:f9:3f:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "vif_mac": "fa:16:3e:f9:3f:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.objects.base [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:48:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:48:33 user nova-compute[75703]:   <uuid>9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15</uuid>
Nov 10 14:48:33 user nova-compute[75703]:   <name>instance-0000000c</name>
Nov 10 14:48:33 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:48:33 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:48:33 user nova-compute[75703]:   <metadata>
Nov 10 14:48:33 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:48:33 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:48:33 user nova-compute[75703]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1625523003</nova:name>
Nov 10 14:48:33 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:48:33</nova:creationTime>
Nov 10 14:48:33 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:48:33 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:48:33 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:48:33 user nova-compute[75703]:       <nova:owner>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:user uuid="90957e8164224a1285c067f0313178a2">tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member</nova:user>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:project uuid="6b19b6b93f7b4e6dbe0ded4d084792f2">tempest-ServerBootFromVolumeStableRescueTest-2023657370</nova:project>
Nov 10 14:48:33 user nova-compute[75703]:       </nova:owner>
Nov 10 14:48:33 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:48:33 user nova-compute[75703]:       <nova:ports>
Nov 10 14:48:33 user nova-compute[75703]:         <nova:port uuid="4a7cd975-41b4-4c54-a814-a852835e2e5f">
Nov 10 14:48:33 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:48:33 user nova-compute[75703]:         </nova:port>
Nov 10 14:48:33 user nova-compute[75703]:       </nova:ports>
Nov 10 14:48:33 user nova-compute[75703]:     </nova:instance>
Nov 10 14:48:33 user nova-compute[75703]:   </metadata>
Nov 10 14:48:33 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:48:33 user nova-compute[75703]:     <system>
Nov 10 14:48:33 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:48:33 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:48:33 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:48:33 user nova-compute[75703]:       <entry name="serial">9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15</entry>
Nov 10 14:48:33 user nova-compute[75703]:       <entry name="uuid">9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15</entry>
Nov 10 14:48:33 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:48:33 user nova-compute[75703]:     </system>
Nov 10 14:48:33 user nova-compute[75703]:   </sysinfo>
Nov 10 14:48:33 user nova-compute[75703]:   <os>
Nov 10 14:48:33 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:48:33 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:48:33 user nova-compute[75703]:   </os>
Nov 10 14:48:33 user nova-compute[75703]:   <features>
Nov 10 14:48:33 user nova-compute[75703]:     <acpi/>
Nov 10 14:48:33 user nova-compute[75703]:     <apic/>
Nov 10 14:48:33 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:48:33 user nova-compute[75703]:   </features>
Nov 10 14:48:33 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:48:33 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:48:33 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:48:33 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:48:33 user nova-compute[75703]:   </clock>
Nov 10 14:48:33 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:48:33 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:48:33 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:48:33 user nova-compute[75703]:   </cpu>
Nov 10 14:48:33 user nova-compute[75703]:   <devices>
Nov 10 14:48:33 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:48:33 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:48:33 user nova-compute[75703]:       <source dev="/dev/sdk"/>
Nov 10 14:48:33 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:48:33 user nova-compute[75703]:       <serial>20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d</serial>
Nov 10 14:48:33 user nova-compute[75703]:     </disk>
Nov 10 14:48:33 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:48:33 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:48:33 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue"/>
Nov 10 14:48:33 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:48:33 user nova-compute[75703]:       <boot order="1"/>
Nov 10 14:48:33 user nova-compute[75703]:     </disk>
Nov 10 14:48:33 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:48:33 user nova-compute[75703]:       <mac address="fa:16:3e:f9:3f:94"/>
Nov 10 14:48:33 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:48:33 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:48:33 user nova-compute[75703]:       <target dev="tap4a7cd975-41"/>
Nov 10 14:48:33 user nova-compute[75703]:     </interface>
Nov 10 14:48:33 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:48:33 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/console.log" append="off"/>
Nov 10 14:48:33 user nova-compute[75703]:     </serial>
Nov 10 14:48:33 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:48:33 user nova-compute[75703]:     <video>
Nov 10 14:48:33 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:48:33 user nova-compute[75703]:     </video>
Nov 10 14:48:33 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:48:33 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:48:33 user nova-compute[75703]:     </rng>
Nov 10 14:48:33 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:48:33 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:48:33 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:48:33 user nova-compute[75703]:     </memballoon>
Nov 10 14:48:33 user nova-compute[75703]:   </devices>
Nov 10 14:48:33 user nova-compute[75703]: </domain>
Nov 10 14:48:33 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:48:33 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance destroyed successfully.
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No VIF found with MAC fa:16:3e:f9:3f:94, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-changed-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing instance network info cache due to event network-changed-745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.network.neutron [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.network.neutron [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updated VIF entry in instance network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG nova.network.neutron [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-755e28c1-5c32-4ede-9db6-e2b212a9c9b9 req-3a08eaf8-65fa-46e7-8c23-acc3533a56b6 service nova] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:35 user nova-compute[75703]: WARNING nova.compute.manager [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:48:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:35 user nova-compute[75703]: WARNING nova.compute.manager [req-15a479ff-61e0-480e-838e-2cc2aa15109e req-8c22cbb1-0470-4a6c-8a23-4abcd5d7f74e service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:48:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance destroyed successfully.
Nov 10 14:48:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-changed-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing instance network info cache due to event network-changed-745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] Acquiring lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] Acquired lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Refreshing network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updated VIF entry in instance network info cache for port 745e6c01-21df-4938-b4de-de63abaafea2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [{"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-80fdacc3-272e-4f2b-96a0-abd4e02f2582 req-b1d6c3aa-a11d-4822-b21d-9d288cb749c9 service nova] Releasing lock "refresh_cache-fc1109cf-0cf6-4d87-8665-c7afc31edc90" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:37 user nova-compute[75703]: WARNING nova.compute.manager [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state active and task_state rescuing.
Nov 10 14:48:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:37 user nova-compute[75703]: WARNING nova.compute.manager [req-85861a8a-40a5-4349-a068-8c84ffa7a552 req-69abddac-e524-4ef0-b254-8703fa3fc1d5 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state active and task_state rescuing.
Nov 10 14:48:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:39 user nova-compute[75703]: WARNING nova.compute.manager [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:48:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:48:39 user nova-compute[75703]: WARNING nova.compute.manager [req-a0283318-2646-4b52-ae5a-be186be6e9e1 req-4ea83c7b-0a21-42fb-961b-fee422481227 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:48:39 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2551c3bf-3247-4e13-ad3b-d20559ada21c tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:48:39 user nova-compute[75703]: DEBUG nova.compute.manager [None req-acf0b34e-a0b6-473a-8e43-6ea45e861794 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:48:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-changed-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Refreshing instance network info cache due to event network-changed-11e5b42e-cf66-4a9e-88b7-818c7c13bee5. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:48:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:48:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:48:47 user nova-compute[75703]: DEBUG nova.network.neutron [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Refreshing network info cache for port 11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:48:48 user nova-compute[75703]: DEBUG nova.network.neutron [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updated VIF entry in instance network info cache for port 11e5b42e-cf66-4a9e-88b7-818c7c13bee5. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:48:48 user nova-compute[75703]: DEBUG nova.network.neutron [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2cb10778-f65d-4519-b340-3efb8eb06b7b req-d8370919-412c-4a7d-a40f-b372394a8764 service nova] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:48:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_power_states {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid d4465989-c669-4edd-b7d2-f71e203b7142 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid edc4e407-e824-4ee7-831b-fe0bf2ac4293 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 642d3e1d-4973-4759-8396-0cf73dcfce41 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 4b7d2537-14fb-4e00-919e-7cd132f46d8e {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: INFO nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (4). Updating power_state in the DB to match the hypervisor.
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:48:55 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:57 user nova-compute[75703]: INFO nova.compute.manager [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Terminating instance
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:48:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance destroyed successfully.
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lazy-loading 'resources' on Instance uuid d4465989-c669-4edd-b7d2-f71e203b7142 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1906531598',display_name='tempest-ServerActionsTestOtherB-server-1906531598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1906531598',id=5,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARDx9Ux4B6BMgGtjVpZzzTTyYZVM+QY3vwtyHv2g+7qq0QV0W7vjrJ9snEFZTJ235/IL1eUdUTo80r4u6wGyIbuiqFuj+oekK9NlahHyizsxVRQGZ86TeYDK/xRsfJJLw==',key_name='tempest-keypair-930182833',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='50238fe1407541f28120b08a92300102',ramdisk_id='',reservation_id='r-5kalh1m3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-830602594',owner_user_name='tempest-ServerActionsTestOtherB-830602594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:48:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='838764a12310402d937f67bea06bbf70',uuid=d4465989-c669-4edd-b7d2-f71e203b7142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converting VIF {"id": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "address": "fa:16:3e:c6:fe:4d", "network": {"id": "87a414c8-7f1f-4a0b-b045-81a22f0f4e7c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1374561824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50238fe1407541f28120b08a92300102", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587cbad5-3a", "ovs_interfaceid": "587cbad5-3ac6-4adf-ad70-7e2d0268e4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_vif [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap587cbad5-3a, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:48:57 user nova-compute[75703]: INFO os_vif [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:fe:4d,bridge_name='br-int',has_traffic_filtering=True,id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be,network=Network(87a414c8-7f1f-4a0b-b045-81a22f0f4e7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587cbad5-3a')
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOBwRxon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:48:57 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[88916ce0-2b03-4315-a66c-0fd12cda0162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:48:57 user nova-compute[75703]: No targets found.
Nov 10 14:48:57 user nova-compute[75703]: iSNS:
Nov 10 14:48:57 user nova-compute[75703]: No targets found.
Nov 10 14:48:57 user nova-compute[75703]: STATIC:
Nov 10 14:48:57 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:48:57 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:48:57 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:48:57 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:48:57 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:48:57 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:48:57 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:48:57 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:48:57 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:48:57 user nova-compute[75703]: FIRMWARE:
Nov 10 14:48:57 user nova-compute[75703]: No targets found.
Nov 10 14:48:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:48:57 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:48:57 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f9c0ae-b616-49cc-8f44-7e3ef7aff150', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed69b3-fc19-4b20-bbc7-7ec1192e42a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[479ede88-6592-4c1b-b67b-11467f685348]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:48:57 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:48:57 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:48:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:48:57 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:48:57 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:48:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4741900>, {}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Disconnecting from: [] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] <== disconnect_volume: return (92ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:48:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deletion of /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize failed
Nov 10 14:48:57 user nova-compute[75703]: INFO nova.compute.manager [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Took 0.23 seconds to destroy the instance on the hypervisor.
Nov 10 14:48:57 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:48:57 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:58 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Took 0.82 seconds to deallocate network for instance.
Nov 10 14:48:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-abffaa9a-afa7-4631-af97-1184e017a806 req-c1d45e64-c396-4e98-8c04-5cf647c939bf service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Received event network-vif-deleted-587cbad5-3ac6-4adf-ad70-7e2d0268e4be {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:48:58 user nova-compute[75703]: INFO nova.compute.manager [req-abffaa9a-afa7-4631-af97-1184e017a806 req-c1d45e64-c396-4e98-8c04-5cf647c939bf service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Neutron deleted interface 587cbad5-3ac6-4adf-ad70-7e2d0268e4be; detaching it from the instance and deleting it from the info cache
Nov 10 14:48:58 user nova-compute[75703]: DEBUG nova.network.neutron [req-abffaa9a-afa7-4631-af97-1184e017a806 req-c1d45e64-c396-4e98-8c04-5cf647c939bf service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-abffaa9a-afa7-4631-af97-1184e017a806 req-c1d45e64-c396-4e98-8c04-5cf647c939bf service nova] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Detach interface failed, port_id=587cbad5-3ac6-4adf-ad70-7e2d0268e4be, reason: Instance d4465989-c669-4edd-b7d2-f71e203b7142 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:48:58 user nova-compute[75703]: INFO nova.compute.manager [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Took 0.13 seconds to detach 1 volumes for instance.
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:48:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:59 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Deleted allocations for instance d4465989-c669-4edd-b7d2-f71e203b7142
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2912ef5-abfd-48b3-b269-9925f2c6ed2d tempest-ServerActionsTestOtherB-830602594 tempest-ServerActionsTestOtherB-830602594-project-member] Lock "d4465989-c669-4edd-b7d2-f71e203b7142" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:48:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:49:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.135234832763672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 4b7d2537-14fb-4e00-919e-7cd132f46d8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:49:02 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:49:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:49:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:49:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:05 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:05 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:06 user nova-compute[75703]: INFO nova.compute.manager [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Detaching volume b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:49:06 user nova-compute[75703]: INFO nova.virt.block_device [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Attempting to driver detach volume b0e70bde-937c-4bb9-a1fc-0ca8e8936550 from mountpoint /dev/vdb
Nov 10 14:49:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Attempting to detach device vdb from instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:49:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:49:06 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:49:06 user nova-compute[75703]:   <source dev="/dev/sdj"/>
Nov 10 14:49:06 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:49:06 user nova-compute[75703]:   <serial>b0e70bde-937c-4bb9-a1fc-0ca8e8936550</serial>
Nov 10 14:49:06 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:49:06 user nova-compute[75703]: </disk>
Nov 10 14:49:06 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:49:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Successfully detached device vdb from instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 from the persistent domain config.
Nov 10 14:49:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:49:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:49:06 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:49:06 user nova-compute[75703]:   <source dev="/dev/sdj"/>
Nov 10 14:49:06 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:49:06 user nova-compute[75703]:   <serial>b0e70bde-937c-4bb9-a1fc-0ca8e8936550</serial>
Nov 10 14:49:06 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:49:06 user nova-compute[75703]: </disk>
Nov 10 14:49:06 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:49:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:49:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:49:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 14:49:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:49:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:49:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:26 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 is timed out.
Nov 10 14:49:26 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Successfully detached device vdb from instance fc1109cf-0cf6-4d87-8665-c7afc31edc90 from the live domain config.
Nov 10 14:49:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mazkwPgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:49:26 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b104495-6ac7-45c9-a7bd-cde331449dde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:49:26 user nova-compute[75703]: No targets found.
Nov 10 14:49:26 user nova-compute[75703]: iSNS:
Nov 10 14:49:26 user nova-compute[75703]: No targets found.
Nov 10 14:49:26 user nova-compute[75703]: STATIC:
Nov 10 14:49:26 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550
Nov 10 14:49:26 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:49:26 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:49:26 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:49:26 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:49:26 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:49:26 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:49:26 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:49:26 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:49:26 user nova-compute[75703]: FIRMWARE:
Nov 10 14:49:26 user nova-compute[75703]: No targets found.
Nov 10 14:49:26 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:49:26 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:49:26 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf922254-3d41-4eb1-8f66-d4b9e3cf3212]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd01fd1-bfb4-43c2-b00a-463f02c490d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:49:26 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:49:26 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:49:26 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:49:26 user nova-compute[75703]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 (non-flash)
Nov 10 14:49:26 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:49:26 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a429e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550'): ({'sdj'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Removing single pathed devices sdj {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc98428-f3fa-4121-9ba3-ecc6c125ae31]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[001cf83c-4b82-49ed-b777-835a70dbdd1e]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Flushing IO for device /dev/sdj {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:49:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4bd7e-a1bf-4583-a2fe-46ca1a06fce0]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90b3d93-0cca-4b2d-9bc9-3c701d89f533]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] SCSI volumes sdj have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[330df54a-796d-4aa8-a149-0764bf78626e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61cab0b-41fd-4d2a-a779-52fa29ab0ee5]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260]
Nov 10 14:49:27 user nova-compute[75703]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550, portal: 172.16.0.220,3260] successful.
Nov 10 14:49:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0e70bde-937c-4bb9-a1fc-0ca8e8936550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c63d3a5-afeb-4b9b-a69c-9a75b0783610]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] <== disconnect_volume: return (297ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:49:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:49:28 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'flavor' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:49:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f3748042-e187-439c-a190-28eb0bc8cfd9 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.972s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:49:34 user nova-compute[75703]: INFO nova.compute.claims [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Claim successful on node user
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.network.neutron [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:49:34 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.policy [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '989965009f8847afae4743f6cb675a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd148c9594bb34eba9d4f17fd50b7d70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:49:34 user nova-compute[75703]: INFO nova.virt.block_device [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Booting with volume faafe044-4e14-4046-aec4-01372c02ef0d at /dev/vda
Nov 10 14:49:34 user nova-compute[75703]: DEBUG os_brick.utils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426a696-2aec-4423-a29a-74841bb30704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba712ee-ef8c-416a-8594-cf92dffd9b80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f2394c-beeb-42ae-94b7-f1c4dcba679d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5fb90c-c098-4e4f-849b-86617a9aaaa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:49:34 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:49:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1619b9c0-c96b-42e9-accc-8f3dbde998de]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG os_brick.utils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:49:34 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating existing volume attachment record: 393cea17-1664-4a69-9aa8-bd2fe49e21d5 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:49:35 user nova-compute[75703]: DEBUG nova.network.neutron [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Successfully created port: 304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:49:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Successfully updated port: 304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquired lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-changed-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Refreshing instance network info cache due to event network-changed-304ff27f-da87-4fb5-96ec-5725ed77ead4. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] Acquiring lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating instance_info_cache with network_info: [{"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Releasing lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance network_info: |[{"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] Acquired lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Refreshing network info cache for port 304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updated VIF entry in instance network info cache for port 304ff27f-da87-4fb5-96ec-5725ed77ead4. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating instance_info_cache with network_info: [{"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:49:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0f21f738-0fc7-4b55-9d97-a988c7b8ceda req-ec8be10a-a9f6-437e-961f-e900dbbccbd1 service nova] Releasing lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:49:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:55 user nova-compute[75703]: INFO nova.compute.manager [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Terminating instance
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-dc81e710-385d-4e03-9821-403c06796129 req-7131b291-619e-4601-b021-38d9957a98cd service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-vif-unplugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-dc81e710-385d-4e03-9821-403c06796129 req-7131b291-619e-4601-b021-38d9957a98cd service nova] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-dc81e710-385d-4e03-9821-403c06796129 req-7131b291-619e-4601-b021-38d9957a98cd service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-dc81e710-385d-4e03-9821-403c06796129 req-7131b291-619e-4601-b021-38d9957a98cd service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-dc81e710-385d-4e03-9821-403c06796129 req-7131b291-619e-4601-b021-38d9957a98cd service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] No waiting events found dispatching network-vif-unplugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-dc81e710-385d-4e03-9821-403c06796129 req-7131b291-619e-4601-b021-38d9957a98cd service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-vif-unplugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Instance destroyed successfully.
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.objects.instance [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'resources' on Instance uuid 4b7d2537-14fb-4e00-919e-7cd132f46d8e {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-655670132',display_name='tempest-VolumesAdminNegativeTest-server-655670132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-655670132',id=15,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad107feaed514542a6e5e91073ed48f0',ramdisk_id='',reservation_id='r-140qtopj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-18732562',owner_user_name='tempest-VolumesAdminNegativeTest-18732562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:47:54Z,user_data=None,user_id='9a55f2945837465eb94a73d1399b52e8',uuid=4b7d2537-14fb-4e00-919e-7cd132f46d8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converting VIF {"id": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "address": "fa:16:3e:aa:53:f9", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0a77a9-6c", "ovs_interfaceid": "3a0a77a9-6cdd-4d85-a619-90221fb8cf68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG os_vif [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a0a77a9-6c, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e68e774-e3ff-4086-b81a-8a9857d6d6e8) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:55 user nova-compute[75703]: INFO os_vif [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:53:f9,bridge_name='br-int',has_traffic_filtering=True,id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0a77a9-6c')
Nov 10 14:49:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Deleting instance files /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e_del
Nov 10 14:49:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Deletion of /opt/stack/data/nova/instances/4b7d2537-14fb-4e00-919e-7cd132f46d8e_del complete
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:49:55 user nova-compute[75703]: INFO nova.compute.manager [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 10 14:49:55 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:49:55 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-7c7f4a42-0f26-4513-b858-338d9361dd2c req-0a0a0268-8f19-445e-8d3b-67169a192922 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-vif-deleted-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:56 user nova-compute[75703]: INFO nova.compute.manager [req-7c7f4a42-0f26-4513-b858-338d9361dd2c req-0a0a0268-8f19-445e-8d3b-67169a192922 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Neutron deleted interface 3a0a77a9-6cdd-4d85-a619-90221fb8cf68; detaching it from the instance and deleting it from the info cache
Nov 10 14:49:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-7c7f4a42-0f26-4513-b858-338d9361dd2c req-0a0a0268-8f19-445e-8d3b-67169a192922 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:49:56 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Took 0.81 seconds to deallocate network for instance.
Nov 10 14:49:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-7c7f4a42-0f26-4513-b858-338d9361dd2c req-0a0a0268-8f19-445e-8d3b-67169a192922 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Detach interface failed, port_id=3a0a77a9-6cdd-4d85-a619-90221fb8cf68, reason: Instance 4b7d2537-14fb-4e00-919e-7cd132f46d8e could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:56 user nova-compute[75703]: INFO nova.compute.manager [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Terminating instance
Nov 10 14:49:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:57 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Deleted allocations for instance 4b7d2537-14fb-4e00-919e-7cd132f46d8e
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ab34324c-cb40-478b-a2a0-53e19fced730 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-7612d58e-c481-41ba-a6e7-a1d1e392d94f req-624061b2-0e2b-4d9e-8414-c74fe8c880a3 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received event network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7612d58e-c481-41ba-a6e7-a1d1e392d94f req-624061b2-0e2b-4d9e-8414-c74fe8c880a3 service nova] Acquiring lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7612d58e-c481-41ba-a6e7-a1d1e392d94f req-624061b2-0e2b-4d9e-8414-c74fe8c880a3 service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7612d58e-c481-41ba-a6e7-a1d1e392d94f req-624061b2-0e2b-4d9e-8414-c74fe8c880a3 service nova] Lock "4b7d2537-14fb-4e00-919e-7cd132f46d8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-7612d58e-c481-41ba-a6e7-a1d1e392d94f req-624061b2-0e2b-4d9e-8414-c74fe8c880a3 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] No waiting events found dispatching network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:49:57 user nova-compute[75703]: WARNING nova.compute.manager [req-7612d58e-c481-41ba-a6e7-a1d1e392d94f req-624061b2-0e2b-4d9e-8414-c74fe8c880a3 service nova] [instance: 4b7d2537-14fb-4e00-919e-7cd132f46d8e] Received unexpected event network-vif-plugged-3a0a77a9-6cdd-4d85-a619-90221fb8cf68 for instance with vm_state deleted and task_state None.
Nov 10 14:49:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Instance destroyed successfully.
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.objects.instance [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lazy-loading 'resources' on Instance uuid fc1109cf-0cf6-4d87-8665-c7afc31edc90 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-973695654',display_name='tempest-ServerStableDeviceRescueTest-server-973695654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-973695654',id=1,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB0V31H1LE0jq8ZHwwOYuY9dh6WAUutxUkKcEDq7GRuM71BtAMyAgvVfoaFDb5lhfiZ0xCHhSRBFq4A1BW68hQ1LJZ78+hhD/PbgkiPfmsJEGA9m9Uy6WStDohrTBc7pQ==',key_name='tempest-keypair-1749947703',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5457f288fd44363b1ffc72ec62ee2ea',ramdisk_id='',reservation_id='r-yxtlxmkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-664853568',owner_user_name='tempest-ServerStableDeviceRescueTest-664853568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65434c01ab4a483a9875ac4d4dfb9993',uuid=fc1109cf-0cf6-4d87-8665-c7afc31edc90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converting VIF {"id": "745e6c01-21df-4938-b4de-de63abaafea2", "address": "fa:16:3e:cf:1a:b4", "network": {"id": "5853a176-05f9-4867-b49d-31cd4267b30b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-433598984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5457f288fd44363b1ffc72ec62ee2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap745e6c01-21", "ovs_interfaceid": "745e6c01-21df-4938-b4de-de63abaafea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG os_vif [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745e6c01-21, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1047a4fc-7810-4621-8d93-c5e6634878e4) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:57 user nova-compute[75703]: INFO os_vif [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:1a:b4,bridge_name='br-int',has_traffic_filtering=True,id=745e6c01-21df-4938-b4de-de63abaafea2,network=Network(5853a176-05f9-4867-b49d-31cd4267b30b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745e6c01-21')
Nov 10 14:49:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Deleting instance files /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90_del
Nov 10 14:49:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Deletion of /opt/stack/data/nova/instances/fc1109cf-0cf6-4d87-8665-c7afc31edc90_del complete
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Skipping network cache update for instance because it is being deleted. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Skipping network cache update for instance because it is Building. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:49:57 user nova-compute[75703]: INFO nova.compute.manager [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-2890d351-c85f-44e0-80f6-53390bf9c07f req-8ac7a552-1704-4ea5-beef-5d52172f5222 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2890d351-c85f-44e0-80f6-53390bf9c07f req-8ac7a552-1704-4ea5-beef-5d52172f5222 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2890d351-c85f-44e0-80f6-53390bf9c07f req-8ac7a552-1704-4ea5-beef-5d52172f5222 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2890d351-c85f-44e0-80f6-53390bf9c07f req-8ac7a552-1704-4ea5-beef-5d52172f5222 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-2890d351-c85f-44e0-80f6-53390bf9c07f req-8ac7a552-1704-4ea5-beef-5d52172f5222 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:49:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-2890d351-c85f-44e0-80f6-53390bf9c07f req-8ac7a552-1704-4ea5-beef-5d52172f5222 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-unplugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:49:58 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Took 0.83 seconds to deallocate network for instance.
Nov 10 14:49:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-7d21dbf3-29f0-4a27-81c2-45b9baa9c4ed req-d5828586-7080-43f1-87ea-67088f4be0f7 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-deleted-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:59 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Deleted allocations for instance fc1109cf-0cf6-4d87-8665-c7afc31edc90
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b19f0d2f-554e-4702-90e6-bd7e4f006fb3 tempest-ServerStableDeviceRescueTest-664853568 tempest-ServerStableDeviceRescueTest-664853568-project-member] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-a35bbb36-88ba-47e2-8810-d313833e10b5 req-9921b960-b020-448d-b1e5-e1bd25082c36 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a35bbb36-88ba-47e2-8810-d313833e10b5 req-9921b960-b020-448d-b1e5-e1bd25082c36 service nova] Acquiring lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a35bbb36-88ba-47e2-8810-d313833e10b5 req-9921b960-b020-448d-b1e5-e1bd25082c36 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a35bbb36-88ba-47e2-8810-d313833e10b5 req-9921b960-b020-448d-b1e5-e1bd25082c36 service nova] Lock "fc1109cf-0cf6-4d87-8665-c7afc31edc90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:49:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-a35bbb36-88ba-47e2-8810-d313833e10b5 req-9921b960-b020-448d-b1e5-e1bd25082c36 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] No waiting events found dispatching network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:49:59 user nova-compute[75703]: WARNING nova.compute.manager [req-a35bbb36-88ba-47e2-8810-d313833e10b5 req-9921b960-b020-448d-b1e5-e1bd25082c36 service nova] [instance: fc1109cf-0cf6-4d87-8665-c7afc31edc90] Received unexpected event network-vif-plugged-745e6c01-21df-4938-b4de-de63abaafea2 for instance with vm_state deleted and task_state None.
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:50:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Creating image(s)
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Ensure instance console log exists: /opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Start _get_guest_xml network_info=[{"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '393cea17-1664-4a69-9aa8-bd2fe49e21d5', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '471151e9-5ab6-483e-a2fa-a32743cf8667', 'attached_at': '', 'detached_at': '', 'volume_id': 'faafe044-4e14-4046-aec4-01372c02ef0d', 'serial': 'faafe044-4e14-4046-aec4-01372c02ef0d'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:50:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8111MB free_disk=25.27350616455078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:02 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:50:02 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:50:02 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:50:02 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af360784-d415-4fcc-9afa-5ce13c8492c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:50:02 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ab72c-ccd3-4bc0-b3f9-eca3aa22c474]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d] added
Nov 10 14:50:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance edc4e407-e824-4ee7-831b-fe0bf2ac4293 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c0ab0-96b3-4a74-9e04-a65286e47d6e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[258b8cf7-1a90-4ef8-8bac-dbb152b6230c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHJBhkya {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHJBhkya" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8561d4f6-1e94-4a8e-a8f1-fc5b197ebff1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHJBhkya'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b22eb3-80ea-4b77-ac14-593222b6b2dd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d73b2-ef3b-4dff-a6ff-03d08076b8ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:50:02 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:50:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:50:02 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:50:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa80e82-afc1-416f-9949-53727ee45ac1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]
Nov 10 14:50:02 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.
Nov 10 14:50:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05882af-82e4-4b83-aeb4-4533ba5d9b3a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[37017bd4-bcf6-4a02-9904-0c3f9ddf6420]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:50:02 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:50:02 user nova-compute[75703]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:50:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:50:02 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:50:02 user nova-compute[75703]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:50:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0040af-15ba-4e93-aefa-ca398cd8675b]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:50:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23963386331343361', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963386331343361', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1896305358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1896305358',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItxue1DidduH42pp9kYmPEujA4hUUQ2wFm6mS1Wiwes11rnDY7FHYVd3vWDvUqZRoIqErX6oavuWfj1PjS9sBJ+dH68+CyzFblvDHNbUAJY9b0Z2ykurlZu+u/RterZLQ==',key_name='tempest-keypair-856963120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d148c9594bb34eba9d4f17fd50b7d70b',ramdisk_id='',reservation_id='r-xkplm0ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1261295049',owner_user_name='tempest-ServerActionsV293TestJSON-1261295049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='989965009f8847afae4743f6cb675a5b',uuid=471151e9-5ab6-483e-a2fa-a32743cf8667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converting VIF {"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.objects.instance [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lazy-loading 'pci_devices' on Instance uuid 471151e9-5ab6-483e-a2fa-a32743cf8667 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:50:03 user nova-compute[75703]:   <uuid>471151e9-5ab6-483e-a2fa-a32743cf8667</uuid>
Nov 10 14:50:03 user nova-compute[75703]:   <name>instance-00000010</name>
Nov 10 14:50:03 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:50:03 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:50:03 user nova-compute[75703]:   <metadata>
Nov 10 14:50:03 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:50:03 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:50:03 user nova-compute[75703]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1896305358</nova:name>
Nov 10 14:50:03 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:50:02</nova:creationTime>
Nov 10 14:50:03 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:50:03 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:50:03 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:50:03 user nova-compute[75703]:       <nova:owner>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:user uuid="989965009f8847afae4743f6cb675a5b">tempest-ServerActionsV293TestJSON-1261295049-project-member</nova:user>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:project uuid="d148c9594bb34eba9d4f17fd50b7d70b">tempest-ServerActionsV293TestJSON-1261295049</nova:project>
Nov 10 14:50:03 user nova-compute[75703]:       </nova:owner>
Nov 10 14:50:03 user nova-compute[75703]:       <nova:ports>
Nov 10 14:50:03 user nova-compute[75703]:         <nova:port uuid="304ff27f-da87-4fb5-96ec-5725ed77ead4">
Nov 10 14:50:03 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 14:50:03 user nova-compute[75703]:         </nova:port>
Nov 10 14:50:03 user nova-compute[75703]:       </nova:ports>
Nov 10 14:50:03 user nova-compute[75703]:     </nova:instance>
Nov 10 14:50:03 user nova-compute[75703]:   </metadata>
Nov 10 14:50:03 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:50:03 user nova-compute[75703]:     <system>
Nov 10 14:50:03 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:50:03 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:50:03 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:50:03 user nova-compute[75703]:       <entry name="serial">471151e9-5ab6-483e-a2fa-a32743cf8667</entry>
Nov 10 14:50:03 user nova-compute[75703]:       <entry name="uuid">471151e9-5ab6-483e-a2fa-a32743cf8667</entry>
Nov 10 14:50:03 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:50:03 user nova-compute[75703]:     </system>
Nov 10 14:50:03 user nova-compute[75703]:   </sysinfo>
Nov 10 14:50:03 user nova-compute[75703]:   <os>
Nov 10 14:50:03 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:50:03 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:50:03 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:50:03 user nova-compute[75703]:   </os>
Nov 10 14:50:03 user nova-compute[75703]:   <features>
Nov 10 14:50:03 user nova-compute[75703]:     <acpi/>
Nov 10 14:50:03 user nova-compute[75703]:     <apic/>
Nov 10 14:50:03 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:50:03 user nova-compute[75703]:   </features>
Nov 10 14:50:03 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:50:03 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:50:03 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:50:03 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:50:03 user nova-compute[75703]:   </clock>
Nov 10 14:50:03 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:50:03 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:50:03 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:50:03 user nova-compute[75703]:   </cpu>
Nov 10 14:50:03 user nova-compute[75703]:   <devices>
Nov 10 14:50:03 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:50:03 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:50:03 user nova-compute[75703]:       <source dev="/dev/sdb"/>
Nov 10 14:50:03 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:50:03 user nova-compute[75703]:       <serial>faafe044-4e14-4046-aec4-01372c02ef0d</serial>
Nov 10 14:50:03 user nova-compute[75703]:     </disk>
Nov 10 14:50:03 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:50:03 user nova-compute[75703]:       <mac address="fa:16:3e:42:be:39"/>
Nov 10 14:50:03 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:03 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:50:03 user nova-compute[75703]:       <target dev="tap304ff27f-da"/>
Nov 10 14:50:03 user nova-compute[75703]:     </interface>
Nov 10 14:50:03 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:50:03 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667/console.log" append="off"/>
Nov 10 14:50:03 user nova-compute[75703]:     </serial>
Nov 10 14:50:03 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:50:03 user nova-compute[75703]:     <video>
Nov 10 14:50:03 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:03 user nova-compute[75703]:     </video>
Nov 10 14:50:03 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:50:03 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:50:03 user nova-compute[75703]:     </rng>
Nov 10 14:50:03 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:50:03 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:50:03 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:50:03 user nova-compute[75703]:     </memballoon>
Nov 10 14:50:03 user nova-compute[75703]:   </devices>
Nov 10 14:50:03 user nova-compute[75703]: </domain>
Nov 10 14:50:03 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1896305358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1896305358',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItxue1DidduH42pp9kYmPEujA4hUUQ2wFm6mS1Wiwes11rnDY7FHYVd3vWDvUqZRoIqErX6oavuWfj1PjS9sBJ+dH68+CyzFblvDHNbUAJY9b0Z2ykurlZu+u/RterZLQ==',key_name='tempest-keypair-856963120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d148c9594bb34eba9d4f17fd50b7d70b',ramdisk_id='',reservation_id='r-xkplm0ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1261295049',owner_user_name='tempest-ServerActionsV293TestJSON-1261295049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='989965009f8847afae4743f6cb675a5b',uuid=471151e9-5ab6-483e-a2fa-a32743cf8667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converting VIF {"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG os_vif [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd6f6643-4b84-58b7-9a61-e64bb282658f', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap304ff27f-da, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap304ff27f-da, col_values=(('qos', UUID('0afeb90b-7616-4b79-92aa-af8924058c10')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap304ff27f-da, col_values=(('external_ids', {'iface-id': '304ff27f-da87-4fb5-96ec-5725ed77ead4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:be:39', 'vm-uuid': '471151e9-5ab6-483e-a2fa-a32743cf8667'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:03 user nova-compute[75703]: INFO os_vif [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da')
Nov 10 14:50:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:50:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] No VIF found with MAC fa:16:3e:42:be:39, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:50:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:05 user nova-compute[75703]: INFO nova.compute.manager [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Terminating instance
Nov 10 14:50:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-0d92e2e3-a18d-4f72-a5c4-0a4eb8852f2a req-b41ff5a4-0a12-4e13-8bff-9f6e0ca6cacf service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-vif-unplugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0d92e2e3-a18d-4f72-a5c4-0a4eb8852f2a req-b41ff5a4-0a12-4e13-8bff-9f6e0ca6cacf service nova] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0d92e2e3-a18d-4f72-a5c4-0a4eb8852f2a req-b41ff5a4-0a12-4e13-8bff-9f6e0ca6cacf service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0d92e2e3-a18d-4f72-a5c4-0a4eb8852f2a req-b41ff5a4-0a12-4e13-8bff-9f6e0ca6cacf service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-0d92e2e3-a18d-4f72-a5c4-0a4eb8852f2a req-b41ff5a4-0a12-4e13-8bff-9f6e0ca6cacf service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] No waiting events found dispatching network-vif-unplugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-0d92e2e3-a18d-4f72-a5c4-0a4eb8852f2a req-b41ff5a4-0a12-4e13-8bff-9f6e0ca6cacf service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-vif-unplugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-c04fc88a-2d50-467f-bb1d-2d39a350da5a req-bc1d9577-5abf-4f8c-8166-957c28baa977 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c04fc88a-2d50-467f-bb1d-2d39a350da5a req-bc1d9577-5abf-4f8c-8166-957c28baa977 service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c04fc88a-2d50-467f-bb1d-2d39a350da5a req-bc1d9577-5abf-4f8c-8166-957c28baa977 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c04fc88a-2d50-467f-bb1d-2d39a350da5a req-bc1d9577-5abf-4f8c-8166-957c28baa977 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-c04fc88a-2d50-467f-bb1d-2d39a350da5a req-bc1d9577-5abf-4f8c-8166-957c28baa977 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:05 user nova-compute[75703]: WARNING nova.compute.manager [req-c04fc88a-2d50-467f-bb1d-2d39a350da5a req-bc1d9577-5abf-4f8c-8166-957c28baa977 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state building and task_state spawning.
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Instance destroyed successfully.
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lazy-loading 'resources' on Instance uuid edc4e407-e824-4ee7-831b-fe0bf2ac4293 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1285669186',display_name='tempest-TestVolumeSwap-server-1285669186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1285669186',id=8,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsHNsl8rVj8A9jSD7MH/Q9xG4ARbWOYyCFa132JW0AI8QWYDgNNc/sFeRHWlADHxpOy7YarEaS1OajWyM5iR7xHd2/dVhY0r0rwcgBsuaUjPOXn1LCJGHV8W3+zY/7KYA==',key_name='tempest-keypair-1665755306',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='698862e14ebc43a89b13a956ee375c15',ramdisk_id='',reservation_id='r-3p1lol5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2111926738',owner_user_name='tempest-TestVolumeSwap-2111926738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa3bd4acf9243ef8ffbe071ce8a0180',uuid=edc4e407-e824-4ee7-831b-fe0bf2ac4293,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Converting VIF {"id": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "address": "fa:16:3e:d4:04:9b", "network": {"id": "a542a750-a7dc-43f1-9fd6-18ec5bd4dff5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1008917277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698862e14ebc43a89b13a956ee375c15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafef69d3-82", "ovs_interfaceid": "afef69d3-82f1-4b64-a61d-b86f908c1f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_vif [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafef69d3-82, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0286fd33-85a1-4e05-902d-521c01772ed4) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:06 user nova-compute[75703]: INFO os_vif [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:04:9b,bridge_name='br-int',has_traffic_filtering=True,id=afef69d3-82f1-4b64-a61d-b86f908c1f19,network=Network(a542a750-a7dc-43f1-9fd6-18ec5bd4dff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafef69d3-82')
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjYhuep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'c59a491b-173c-430b-9e3f-7d9af9f95962'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:50:06 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39b4b5-b691-4e84-aef5-6db6dbbfe6b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:50:06 user nova-compute[75703]: No targets found.
Nov 10 14:50:06 user nova-compute[75703]: iSNS:
Nov 10 14:50:06 user nova-compute[75703]: No targets found.
Nov 10 14:50:06 user nova-compute[75703]: STATIC:
Nov 10 14:50:06 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962
Nov 10 14:50:06 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:50:06 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:50:06 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d
Nov 10 14:50:06 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:50:06 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:50:06 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:50:06 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:50:06 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:50:06 user nova-compute[75703]: FIRMWARE:
Nov 10 14:50:06 user nova-compute[75703]: No targets found.
Nov 10 14:50:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:50:06 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:50:06 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfe722f-5cb7-443a-988f-89d8b2582b57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37940a4-68bb-4dc2-b6b1-ce84fa80bcfe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:50:06 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:50:06 user nova-compute[75703]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:50:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 (non-flash)
Nov 10 14:50:06 user nova-compute[75703]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:50:06 user nova-compute[75703]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:50:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a42827a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962'): ({'sdi'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Removing single pathed devices sdi {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1ed202-3b48-4ac7-8a3b-ee1de237e3aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd98fc83-0238-4b15-8c5a-3f7d41d5984e]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Flushing IO for device /dev/sdi {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[06334d4d-e728-4f1d-91c7-eecea28cb646]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6873e99a-9529-42be-98e0-fa6d93de0755]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] SCSI volumes sdi have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a62a2a7-ba53-49eb-a4f2-a99dcff22ae0]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a588d3-22e1-493d-b201-da372252a073]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260]
Nov 10 14:50:06 user nova-compute[75703]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962, portal: 172.16.0.220,3260] successful.
Nov 10 14:50:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59a491b-173c-430b-9e3f-7d9af9f95962 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecebfdd3-c583-4aef-b764-610d41a8f25f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] <== disconnect_volume: return (345ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:50:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Deleting instance files /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293_del
Nov 10 14:50:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Deletion of /opt/stack/data/nova/instances/edc4e407-e824-4ee7-831b-fe0bf2ac4293_del complete
Nov 10 14:50:06 user nova-compute[75703]: INFO nova.compute.manager [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 10 14:50:06 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:50:06 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-4c7a3cc5-0a0d-48ea-8f9e-f2391b66877c req-354a6f22-142f-4321-9c54-0338245a3aa4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4c7a3cc5-0a0d-48ea-8f9e-f2391b66877c req-354a6f22-142f-4321-9c54-0338245a3aa4 service nova] Acquiring lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4c7a3cc5-0a0d-48ea-8f9e-f2391b66877c req-354a6f22-142f-4321-9c54-0338245a3aa4 service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4c7a3cc5-0a0d-48ea-8f9e-f2391b66877c req-354a6f22-142f-4321-9c54-0338245a3aa4 service nova] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-4c7a3cc5-0a0d-48ea-8f9e-f2391b66877c req-354a6f22-142f-4321-9c54-0338245a3aa4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] No waiting events found dispatching network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:07 user nova-compute[75703]: WARNING nova.compute.manager [req-4c7a3cc5-0a0d-48ea-8f9e-f2391b66877c req-354a6f22-142f-4321-9c54-0338245a3aa4 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received unexpected event network-vif-plugged-afef69d3-82f1-4b64-a61d-b86f908c1f19 for instance with vm_state active and task_state deleting.
Nov 10 14:50:07 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:07 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Took 0.92 seconds to deallocate network for instance.
Nov 10 14:50:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:07 user nova-compute[75703]: WARNING nova.compute.manager [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state building and task_state spawning.
Nov 10 14:50:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-24eb825b-7198-434f-9e05-65ca11f83aa1 req-199125e4-b50a-4f67-925e-486c43832c60 service nova] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Received event network-vif-deleted-afef69d3-82f1-4b64-a61d-b86f908c1f19 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:50:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance spawned successfully.
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:08 user nova-compute[75703]: INFO nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 10 14:50:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:50:08 user nova-compute[75703]: INFO nova.compute.manager [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Took 34.22 seconds to build instance.
Nov 10 14:50:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ca113b42-75f6-424b-9aa9-d65df6443f87 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.322s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:19 user nova-compute[75703]: INFO nova.compute.manager [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] [instance: edc4e407-e824-4ee7-831b-fe0bf2ac4293] Took 12.08 seconds to detach 1 volumes for instance.
Nov 10 14:50:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:20 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:20 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:20 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Deleted allocations for instance edc4e407-e824-4ee7-831b-fe0bf2ac4293
Nov 10 14:50:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c341130-59b4-4d4a-8b27-5b95b17a5ebe tempest-TestVolumeSwap-2111926738 tempest-TestVolumeSwap-2111926738-project-member] Lock "edc4e407-e824-4ee7-831b-fe0bf2ac4293" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.268s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:20 user nova-compute[75703]: INFO nova.compute.manager [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Unrescuing
Nov 10 14:50:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG nova.objects.instance [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'flavor' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-e5ba25ab-51ac-436c-96db-bcd39224222e req-584e75d7-34a7-41b4-8587-edd783aaef02 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e5ba25ab-51ac-436c-96db-bcd39224222e req-584e75d7-34a7-41b4-8587-edd783aaef02 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e5ba25ab-51ac-436c-96db-bcd39224222e req-584e75d7-34a7-41b4-8587-edd783aaef02 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e5ba25ab-51ac-436c-96db-bcd39224222e req-584e75d7-34a7-41b4-8587-edd783aaef02 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-e5ba25ab-51ac-436c-96db-bcd39224222e req-584e75d7-34a7-41b4-8587-edd783aaef02 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:21 user nova-compute[75703]: WARNING nova.compute.manager [req-e5ba25ab-51ac-436c-96db-bcd39224222e req-584e75d7-34a7-41b4-8587-edd783aaef02 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:50:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:22 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance destroyed successfully.
Nov 10 14:50:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f832206-a6da-4930-b4e9-a741c7d90a4a req-0c704018-4517-4929-845d-4dca6394946e service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5f832206-a6da-4930-b4e9-a741c7d90a4a req-0c704018-4517-4929-845d-4dca6394946e service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5f832206-a6da-4930-b4e9-a741c7d90a4a req-0c704018-4517-4929-845d-4dca6394946e service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5f832206-a6da-4930-b4e9-a741c7d90a4a req-0c704018-4517-4929-845d-4dca6394946e service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f832206-a6da-4930-b4e9-a741c7d90a4a req-0c704018-4517-4929-845d-4dca6394946e service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:24 user nova-compute[75703]: WARNING nova.compute.manager [req-5f832206-a6da-4930-b4e9-a741c7d90a4a req-0c704018-4517-4929-845d-4dca6394946e service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:50:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:26 user nova-compute[75703]: WARNING nova.compute.manager [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:50:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:26 user nova-compute[75703]: WARNING nova.compute.manager [req-f22ac6d3-8083-443c-b9c8-fb02a879d7c4 req-acfde222-721f-45b5-a6a5-91a659cd9703 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:50:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4882ff5d-ce9a-4c18-a72b-47097cb35e3e tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:50:27 user nova-compute[75703]: INFO nova.compute.claims [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Claim successful on node user
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:50:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.policy [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b7b8488f5964719b7b47ac4416c59ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703fd918f4547218ac7ef97d6b1bbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:50:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Creating image(s)
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:50:27 user nova-compute[75703]: INFO nova.compute.claims [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Claim successful on node user
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk 1073741824" returned: 0 in 0.058s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.network.neutron [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.policy [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b7b8488f5964719b7b47ac4416c59ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703fd918f4547218ac7ef97d6b1bbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:50:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Creating image(s)
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Cannot resize image /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Ensure instance console log exists: /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Successfully created port: 887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk 1073741824" returned: 0 in 0.054s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Cannot resize image /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Ensure instance console log exists: /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Successfully created port: f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Successfully updated port: 887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Successfully updated port: f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-changed-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Refreshing instance network info cache due to event network-changed-887034ca-08fe-490d-9562-7ab8c57a8f21. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-changed-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Refreshing instance network info cache due to event network-changed-f93fde13-7f17-4094-a51c-374930061948. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] Acquiring lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:50:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance network_info: |[{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Refreshing network info cache for port 887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Start _get_guest_xml network_info=[{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:50:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179544045',display_name='tempest-ServerRescueNegativeTestJSON-server-1179544045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179544045',id=17,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-qo37v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:28Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=a7660cf1-f3ab-4ce6-990f-676f84317fd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'pci_devices' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:50:31 user nova-compute[75703]:   <uuid>a7660cf1-f3ab-4ce6-990f-676f84317fd6</uuid>
Nov 10 14:50:31 user nova-compute[75703]:   <name>instance-00000011</name>
Nov 10 14:50:31 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:50:31 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:50:31 user nova-compute[75703]:   <metadata>
Nov 10 14:50:31 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:50:31 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1179544045</nova:name>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:50:31</nova:creationTime>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:50:31 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:50:31 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:owner>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:user uuid="6b7b8488f5964719b7b47ac4416c59ea">tempest-ServerRescueNegativeTestJSON-1926780524-project-member</nova:user>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:project uuid="5703fd918f4547218ac7ef97d6b1bbdc">tempest-ServerRescueNegativeTestJSON-1926780524</nova:project>
Nov 10 14:50:31 user nova-compute[75703]:       </nova:owner>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:ports>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:port uuid="887034ca-08fe-490d-9562-7ab8c57a8f21">
Nov 10 14:50:31 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 14:50:31 user nova-compute[75703]:         </nova:port>
Nov 10 14:50:31 user nova-compute[75703]:       </nova:ports>
Nov 10 14:50:31 user nova-compute[75703]:     </nova:instance>
Nov 10 14:50:31 user nova-compute[75703]:   </metadata>
Nov 10 14:50:31 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:50:31 user nova-compute[75703]:     <system>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="serial">a7660cf1-f3ab-4ce6-990f-676f84317fd6</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="uuid">a7660cf1-f3ab-4ce6-990f-676f84317fd6</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:50:31 user nova-compute[75703]:     </system>
Nov 10 14:50:31 user nova-compute[75703]:   </sysinfo>
Nov 10 14:50:31 user nova-compute[75703]:   <os>
Nov 10 14:50:31 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:50:31 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:50:31 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:50:31 user nova-compute[75703]:   </os>
Nov 10 14:50:31 user nova-compute[75703]:   <features>
Nov 10 14:50:31 user nova-compute[75703]:     <acpi/>
Nov 10 14:50:31 user nova-compute[75703]:     <apic/>
Nov 10 14:50:31 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:50:31 user nova-compute[75703]:   </features>
Nov 10 14:50:31 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:50:31 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:50:31 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:50:31 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:50:31 user nova-compute[75703]:   </clock>
Nov 10 14:50:31 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:50:31 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:50:31 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:50:31 user nova-compute[75703]:   </cpu>
Nov 10 14:50:31 user nova-compute[75703]:   <devices>
Nov 10 14:50:31 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:50:31 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:50:31 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk"/>
Nov 10 14:50:31 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:50:31 user nova-compute[75703]:     </disk>
Nov 10 14:50:31 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:50:31 user nova-compute[75703]:       <mac address="fa:16:3e:e0:e4:6b"/>
Nov 10 14:50:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:31 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:50:31 user nova-compute[75703]:       <target dev="tap887034ca-08"/>
Nov 10 14:50:31 user nova-compute[75703]:     </interface>
Nov 10 14:50:31 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:50:31 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/console.log" append="off"/>
Nov 10 14:50:31 user nova-compute[75703]:     </serial>
Nov 10 14:50:31 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:50:31 user nova-compute[75703]:     <video>
Nov 10 14:50:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:31 user nova-compute[75703]:     </video>
Nov 10 14:50:31 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:50:31 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:50:31 user nova-compute[75703]:     </rng>
Nov 10 14:50:31 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:50:31 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:50:31 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:50:31 user nova-compute[75703]:     </memballoon>
Nov 10 14:50:31 user nova-compute[75703]:   </devices>
Nov 10 14:50:31 user nova-compute[75703]: </domain>
Nov 10 14:50:31 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179544045',display_name='tempest-ServerRescueNegativeTestJSON-server-1179544045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179544045',id=17,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-qo37v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:28Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=a7660cf1-f3ab-4ce6-990f-676f84317fd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG os_vif [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11c5cf06-725b-5f83-a8ee-bb736d63a318', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap887034ca-08, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap887034ca-08, col_values=(('qos', UUID('9409487a-0607-4244-956c-06500e55ef93')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap887034ca-08, col_values=(('external_ids', {'iface-id': '887034ca-08fe-490d-9562-7ab8c57a8f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e4:6b', 'vm-uuid': 'a7660cf1-f3ab-4ce6-990f-676f84317fd6'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updating instance_info_cache with network_info: [{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance network_info: |[{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] Acquired lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.neutron [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Refreshing network info cache for port f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Start _get_guest_xml network_info=[{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:50:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: INFO os_vif [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08')
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1275294798',display_name='tempest-ServerRescueNegativeTestJSON-server-1275294798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1275294798',id=18,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-w7jqnks9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:29Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=570421c8-0cd6-48fa-b3ee-87e60ac9e8df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'pci_devices' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:50:31 user nova-compute[75703]:   <uuid>570421c8-0cd6-48fa-b3ee-87e60ac9e8df</uuid>
Nov 10 14:50:31 user nova-compute[75703]:   <name>instance-00000012</name>
Nov 10 14:50:31 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:50:31 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:50:31 user nova-compute[75703]:   <metadata>
Nov 10 14:50:31 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:50:31 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1275294798</nova:name>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:50:31</nova:creationTime>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:50:31 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:50:31 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:owner>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:user uuid="6b7b8488f5964719b7b47ac4416c59ea">tempest-ServerRescueNegativeTestJSON-1926780524-project-member</nova:user>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:project uuid="5703fd918f4547218ac7ef97d6b1bbdc">tempest-ServerRescueNegativeTestJSON-1926780524</nova:project>
Nov 10 14:50:31 user nova-compute[75703]:       </nova:owner>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:50:31 user nova-compute[75703]:       <nova:ports>
Nov 10 14:50:31 user nova-compute[75703]:         <nova:port uuid="f93fde13-7f17-4094-a51c-374930061948">
Nov 10 14:50:31 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 14:50:31 user nova-compute[75703]:         </nova:port>
Nov 10 14:50:31 user nova-compute[75703]:       </nova:ports>
Nov 10 14:50:31 user nova-compute[75703]:     </nova:instance>
Nov 10 14:50:31 user nova-compute[75703]:   </metadata>
Nov 10 14:50:31 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:50:31 user nova-compute[75703]:     <system>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="serial">570421c8-0cd6-48fa-b3ee-87e60ac9e8df</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="uuid">570421c8-0cd6-48fa-b3ee-87e60ac9e8df</entry>
Nov 10 14:50:31 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:50:31 user nova-compute[75703]:     </system>
Nov 10 14:50:31 user nova-compute[75703]:   </sysinfo>
Nov 10 14:50:31 user nova-compute[75703]:   <os>
Nov 10 14:50:31 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:50:31 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:50:31 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:50:31 user nova-compute[75703]:   </os>
Nov 10 14:50:31 user nova-compute[75703]:   <features>
Nov 10 14:50:31 user nova-compute[75703]:     <acpi/>
Nov 10 14:50:31 user nova-compute[75703]:     <apic/>
Nov 10 14:50:31 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:50:31 user nova-compute[75703]:   </features>
Nov 10 14:50:31 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:50:31 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:50:31 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:50:31 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:50:31 user nova-compute[75703]:   </clock>
Nov 10 14:50:31 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:50:31 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:50:31 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:50:31 user nova-compute[75703]:   </cpu>
Nov 10 14:50:31 user nova-compute[75703]:   <devices>
Nov 10 14:50:31 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:50:31 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:50:31 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk"/>
Nov 10 14:50:31 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:50:31 user nova-compute[75703]:     </disk>
Nov 10 14:50:31 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:50:31 user nova-compute[75703]:       <mac address="fa:16:3e:07:fe:81"/>
Nov 10 14:50:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:31 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:50:31 user nova-compute[75703]:       <target dev="tapf93fde13-7f"/>
Nov 10 14:50:31 user nova-compute[75703]:     </interface>
Nov 10 14:50:31 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:50:31 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/console.log" append="off"/>
Nov 10 14:50:31 user nova-compute[75703]:     </serial>
Nov 10 14:50:31 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:50:31 user nova-compute[75703]:     <video>
Nov 10 14:50:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:31 user nova-compute[75703]:     </video>
Nov 10 14:50:31 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:50:31 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:50:31 user nova-compute[75703]:     </rng>
Nov 10 14:50:31 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:50:31 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:50:31 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:50:31 user nova-compute[75703]:     </memballoon>
Nov 10 14:50:31 user nova-compute[75703]:   </devices>
Nov 10 14:50:31 user nova-compute[75703]: </domain>
Nov 10 14:50:31 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1275294798',display_name='tempest-ServerRescueNegativeTestJSON-server-1275294798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1275294798',id=18,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-w7jqnks9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:29Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=570421c8-0cd6-48fa-b3ee-87e60ac9e8df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG os_vif [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9cfcd46-3b79-5e88-9a5a-e464983484c1', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93fde13-7f, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf93fde13-7f, col_values=(('qos', UUID('7f889a29-73f6-43b9-8b2c-5e22d4a685f2')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf93fde13-7f, col_values=(('external_ids', {'iface-id': 'f93fde13-7f17-4094-a51c-374930061948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:fe:81', 'vm-uuid': '570421c8-0cd6-48fa-b3ee-87e60ac9e8df'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:e0:e4:6b, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:31 user nova-compute[75703]: INFO os_vif [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f')
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:07:fe:81, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.neutron [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updated VIF entry in instance network info cache for port f93fde13-7f17-4094-a51c-374930061948. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG nova.network.neutron [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updating instance_info_cache with network_info: [{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff855b96-59db-4f39-9e95-9ae5f791f117 req-b567a41b-8920-4a1a-9147-bb609f3010a7 service nova] Releasing lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updated VIF entry in instance network info cache for port 887034ca-08fe-490d-9562-7ab8c57a8f21. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:50:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9d9ade8-7fcb-4cc4-816b-607c476f0957 req-f273d3de-498d-4ec0-88c6-465e2dffeeaf service nova] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ed501d8-43af-425b-a569-7750713b2818 req-7284a49f-7543-4c91-954b-9082c4ae232b service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ed501d8-43af-425b-a569-7750713b2818 req-7284a49f-7543-4c91-954b-9082c4ae232b service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ed501d8-43af-425b-a569-7750713b2818 req-7284a49f-7543-4c91-954b-9082c4ae232b service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ed501d8-43af-425b-a569-7750713b2818 req-7284a49f-7543-4c91-954b-9082c4ae232b service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ed501d8-43af-425b-a569-7750713b2818 req-7284a49f-7543-4c91-954b-9082c4ae232b service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:34 user nova-compute[75703]: WARNING nova.compute.manager [req-1ed501d8-43af-425b-a569-7750713b2818 req-7284a49f-7543-4c91-954b-9082c4ae232b service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state building and task_state spawning.
Nov 10 14:50:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e8fb6b5a-e446-4f75-b2ba-cf3e06852605 req-4949d91f-197e-49a5-adf4-11d66f667443 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e8fb6b5a-e446-4f75-b2ba-cf3e06852605 req-4949d91f-197e-49a5-adf4-11d66f667443 service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e8fb6b5a-e446-4f75-b2ba-cf3e06852605 req-4949d91f-197e-49a5-adf4-11d66f667443 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e8fb6b5a-e446-4f75-b2ba-cf3e06852605 req-4949d91f-197e-49a5-adf4-11d66f667443 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e8fb6b5a-e446-4f75-b2ba-cf3e06852605 req-4949d91f-197e-49a5-adf4-11d66f667443 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:36 user nova-compute[75703]: WARNING nova.compute.manager [req-e8fb6b5a-e446-4f75-b2ba-cf3e06852605 req-4949d91f-197e-49a5-adf4-11d66f667443 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state building and task_state spawning.
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:50:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance spawned successfully.
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: INFO nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Took 10.87 seconds to spawn the instance on the hypervisor.
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:50:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance spawned successfully.
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:50:38 user nova-compute[75703]: INFO nova.compute.manager [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Took 11.73 seconds to build instance.
Nov 10 14:50:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-955cac0f-c388-4fd7-b5bb-e80963256e1f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.858s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:38 user nova-compute[75703]: INFO nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Took 10.19 seconds to spawn the instance on the hypervisor.
Nov 10 14:50:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:50:38 user nova-compute[75703]: INFO nova.compute.manager [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Took 11.25 seconds to build instance.
Nov 10 14:50:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-73fbc0e0-d61c-4b61-b246-d3889d1754b9 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.387s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-73a7d417-8f27-411e-8a2a-ce37af174a57 req-c940127c-33a3-4220-990e-ab3350472b81 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-73a7d417-8f27-411e-8a2a-ce37af174a57 req-c940127c-33a3-4220-990e-ab3350472b81 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-73a7d417-8f27-411e-8a2a-ce37af174a57 req-c940127c-33a3-4220-990e-ab3350472b81 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-73a7d417-8f27-411e-8a2a-ce37af174a57 req-c940127c-33a3-4220-990e-ab3350472b81 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-73a7d417-8f27-411e-8a2a-ce37af174a57 req-c940127c-33a3-4220-990e-ab3350472b81 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:41 user nova-compute[75703]: WARNING nova.compute.manager [req-73a7d417-8f27-411e-8a2a-ce37af174a57 req-c940127c-33a3-4220-990e-ab3350472b81 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state active and task_state None.
Nov 10 14:50:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-d0b73a82-ddd4-483d-8e0d-8531b73f6725 req-03d40946-e655-4ff0-b96c-d5c3f7c94b22 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d0b73a82-ddd4-483d-8e0d-8531b73f6725 req-03d40946-e655-4ff0-b96c-d5c3f7c94b22 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d0b73a82-ddd4-483d-8e0d-8531b73f6725 req-03d40946-e655-4ff0-b96c-d5c3f7c94b22 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d0b73a82-ddd4-483d-8e0d-8531b73f6725 req-03d40946-e655-4ff0-b96c-d5c3f7c94b22 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-d0b73a82-ddd4-483d-8e0d-8531b73f6725 req-03d40946-e655-4ff0-b96c-d5c3f7c94b22 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:43 user nova-compute[75703]: WARNING nova.compute.manager [req-d0b73a82-ddd4-483d-8e0d-8531b73f6725 req-03d40946-e655-4ff0-b96c-d5c3f7c94b22 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state active and task_state None.
Nov 10 14:50:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:50:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:50:48 user nova-compute[75703]: INFO nova.compute.claims [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Claim successful on node user
Nov 10 14:50:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.153s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:50:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.policy [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23ee54b16d604b829f2088d8e850c48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ddb2fd8ebd40b0bee398bd9969a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:50:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Creating image(s)
Nov 10 14:50:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.536s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.233s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk 1073741824" returned: 0 in 0.065s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.230s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Cannot resize image /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Ensure instance console log exists: /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG nova.network.neutron [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Successfully created port: 3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:52 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:50:52 user nova-compute[75703]: INFO nova.compute.claims [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Claim successful on node user
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:50:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.policy [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75341ec55afc47b89b4a56e33c0bf9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1449926681744a1996072effc9947b88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:50:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Creating image(s)
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "/opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "/opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "/opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.network.neutron [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Successfully updated port: 3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquired lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:53 user nova-compute[75703]: DEBUG nova.network.neutron [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-changed-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Refreshing instance network info cache due to event network-changed-3d2f146b-0393-4de8-9e6a-196f466b3872. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] Acquiring lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.487s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.268s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk 1073741824" returned: 0 in 0.090s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating instance_info_cache with network_info: [{"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Releasing lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance network_info: |[{"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] Acquired lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.neutron [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Refreshing network info cache for port 3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Start _get_guest_xml network_info=[{"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Successfully created port: 839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:50:54 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:54 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993196221',display_name='tempest-tempest.common.compute-instance-1993196221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993196221',id=19,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOXsfg8OtAF6y15f8pyf2zdKsfHHvx2Sl4DlV0LLsRlXzWk7nagjDQvEd+0CWh/8TFWwBen16W3DyFwmj7DfNKj73/gZHHXZoxnnPAJ3cPQ5Wjy8d1NpdmIwa4vcLAv4w==',key_name='tempest-keypair-2121173221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-m55zusr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=0b071772-83ac-4848-b735-9dcfd41ee88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.objects.instance [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.368s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:50:54 user nova-compute[75703]:   <uuid>0b071772-83ac-4848-b735-9dcfd41ee88a</uuid>
Nov 10 14:50:54 user nova-compute[75703]:   <name>instance-00000013</name>
Nov 10 14:50:54 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:50:54 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:50:54 user nova-compute[75703]:   <metadata>
Nov 10 14:50:54 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:50:54 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:50:54 user nova-compute[75703]:       <nova:name>tempest-tempest.common.compute-instance-1993196221</nova:name>
Nov 10 14:50:54 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:50:54</nova:creationTime>
Nov 10 14:50:54 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:50:54 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:50:54 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:50:54 user nova-compute[75703]:       <nova:owner>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:user uuid="23ee54b16d604b829f2088d8e850c48c">tempest-ServerActionsTestOtherA-1989770067-project-member</nova:user>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:project uuid="37ddb2fd8ebd40b0bee398bd9969a0ee">tempest-ServerActionsTestOtherA-1989770067</nova:project>
Nov 10 14:50:54 user nova-compute[75703]:       </nova:owner>
Nov 10 14:50:54 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:50:54 user nova-compute[75703]:       <nova:ports>
Nov 10 14:50:54 user nova-compute[75703]:         <nova:port uuid="3d2f146b-0393-4de8-9e6a-196f466b3872">
Nov 10 14:50:54 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 14:50:54 user nova-compute[75703]:         </nova:port>
Nov 10 14:50:54 user nova-compute[75703]:       </nova:ports>
Nov 10 14:50:54 user nova-compute[75703]:     </nova:instance>
Nov 10 14:50:54 user nova-compute[75703]:   </metadata>
Nov 10 14:50:54 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:50:54 user nova-compute[75703]:     <system>
Nov 10 14:50:54 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:50:54 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:50:54 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:50:54 user nova-compute[75703]:       <entry name="serial">0b071772-83ac-4848-b735-9dcfd41ee88a</entry>
Nov 10 14:50:54 user nova-compute[75703]:       <entry name="uuid">0b071772-83ac-4848-b735-9dcfd41ee88a</entry>
Nov 10 14:50:54 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:50:54 user nova-compute[75703]:     </system>
Nov 10 14:50:54 user nova-compute[75703]:   </sysinfo>
Nov 10 14:50:54 user nova-compute[75703]:   <os>
Nov 10 14:50:54 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:50:54 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:50:54 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:50:54 user nova-compute[75703]:   </os>
Nov 10 14:50:54 user nova-compute[75703]:   <features>
Nov 10 14:50:54 user nova-compute[75703]:     <acpi/>
Nov 10 14:50:54 user nova-compute[75703]:     <apic/>
Nov 10 14:50:54 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:50:54 user nova-compute[75703]:   </features>
Nov 10 14:50:54 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:50:54 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:50:54 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:50:54 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:50:54 user nova-compute[75703]:   </clock>
Nov 10 14:50:54 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:50:54 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:50:54 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:50:54 user nova-compute[75703]:   </cpu>
Nov 10 14:50:54 user nova-compute[75703]:   <devices>
Nov 10 14:50:54 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:50:54 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:50:54 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk"/>
Nov 10 14:50:54 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:50:54 user nova-compute[75703]:     </disk>
Nov 10 14:50:54 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:50:54 user nova-compute[75703]:       <mac address="fa:16:3e:4d:22:71"/>
Nov 10 14:50:54 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:54 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:50:54 user nova-compute[75703]:       <target dev="tap3d2f146b-03"/>
Nov 10 14:50:54 user nova-compute[75703]:     </interface>
Nov 10 14:50:54 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:50:54 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/console.log" append="off"/>
Nov 10 14:50:54 user nova-compute[75703]:     </serial>
Nov 10 14:50:54 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:50:54 user nova-compute[75703]:     <video>
Nov 10 14:50:54 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:54 user nova-compute[75703]:     </video>
Nov 10 14:50:54 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:50:54 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:50:54 user nova-compute[75703]:     </rng>
Nov 10 14:50:54 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:50:54 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:50:54 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:50:54 user nova-compute[75703]:     </memballoon>
Nov 10 14:50:54 user nova-compute[75703]:   </devices>
Nov 10 14:50:54 user nova-compute[75703]: </domain>
Nov 10 14:50:54 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993196221',display_name='tempest-tempest.common.compute-instance-1993196221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993196221',id=19,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOXsfg8OtAF6y15f8pyf2zdKsfHHvx2Sl4DlV0LLsRlXzWk7nagjDQvEd+0CWh/8TFWwBen16W3DyFwmj7DfNKj73/gZHHXZoxnnPAJ3cPQ5Wjy8d1NpdmIwa4vcLAv4w==',key_name='tempest-keypair-2121173221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-m55zusr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=0b071772-83ac-4848-b735-9dcfd41ee88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG os_vif [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a0653de-c9a5-58eb-9e06-26177b608d64', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d2f146b-03, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d2f146b-03, col_values=(('qos', UUID('ead47cce-3c03-4a0c-a0f9-c25771cb0c4f')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d2f146b-03, col_values=(('external_ids', {'iface-id': '3d2f146b-0393-4de8-9e6a-196f466b3872', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:22:71', 'vm-uuid': '0b071772-83ac-4848-b735-9dcfd41ee88a'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:54 user nova-compute[75703]: INFO os_vif [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03')
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No VIF found with MAC fa:16:3e:4d:22:71, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Cannot resize image /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Ensure instance console log exists: /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updated VIF entry in instance network info cache for port 3d2f146b-0393-4de8-9e6a-196f466b3872. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating instance_info_cache with network_info: [{"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-555f4c64-0fc2-498d-afcb-20e797570d4b req-fcf09786-680e-4cf4-9247-78d15d9b4160 service nova] Releasing lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Acquiring lock "99322b90-f340-4d6e-9a17-037f9b3df327" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Lock "99322b90-f340-4d6e-9a17-037f9b3df327" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Successfully updated port: 839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquired lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-changed-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Refreshing instance network info cache due to event network-changed-839dd737-26d3-4eea-9600-63d40f2e6181. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] Acquiring lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:50:55 user nova-compute[75703]: INFO nova.compute.claims [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Claim successful on node user
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.neutron [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updating instance_info_cache with network_info: [{"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Releasing lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Instance network_info: |[{"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] Acquired lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Refreshing network info cache for port 839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Start _get_guest_xml network_info=[{"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:50:56 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:56 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-810835417',display_name='tempest-TestServerVolumeAttachmentScenario-server-810835417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-810835417',id=20,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN9G0BFa2/wJI9y3fdq4+4V3mIrKzCRIk2QdKrxxdpoPgILDUxwv0/V1bsLhFYzgGX2rYy0TA6pl4iq7wIAY9KrjOAbkYj13C1kjk5M4NSRdmWOW/DuhK7LUW8eZ+2ksw==',key_name='tempest-keypair-1410498672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1449926681744a1996072effc9947b88',ramdisk_id='',reservation_id='r-u5pbvdb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1430018624',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1430018624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75341ec55afc47b89b4a56e33c0bf9e2',uuid=e01fd056-4ccd-4958-81a8-e7f3665feed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Converting VIF {"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.objects.instance [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'pci_devices' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:50:56 user nova-compute[75703]:   <uuid>e01fd056-4ccd-4958-81a8-e7f3665feed1</uuid>
Nov 10 14:50:56 user nova-compute[75703]:   <name>instance-00000014</name>
Nov 10 14:50:56 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:50:56 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:50:56 user nova-compute[75703]:   <metadata>
Nov 10 14:50:56 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:50:56 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:50:56 user nova-compute[75703]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-810835417</nova:name>
Nov 10 14:50:56 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:50:56</nova:creationTime>
Nov 10 14:50:56 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:50:56 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:50:56 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:50:56 user nova-compute[75703]:       <nova:owner>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:user uuid="75341ec55afc47b89b4a56e33c0bf9e2">tempest-TestServerVolumeAttachmentScenario-1430018624-project-member</nova:user>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:project uuid="1449926681744a1996072effc9947b88">tempest-TestServerVolumeAttachmentScenario-1430018624</nova:project>
Nov 10 14:50:56 user nova-compute[75703]:       </nova:owner>
Nov 10 14:50:56 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:50:56 user nova-compute[75703]:       <nova:ports>
Nov 10 14:50:56 user nova-compute[75703]:         <nova:port uuid="839dd737-26d3-4eea-9600-63d40f2e6181">
Nov 10 14:50:56 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 14:50:56 user nova-compute[75703]:         </nova:port>
Nov 10 14:50:56 user nova-compute[75703]:       </nova:ports>
Nov 10 14:50:56 user nova-compute[75703]:     </nova:instance>
Nov 10 14:50:56 user nova-compute[75703]:   </metadata>
Nov 10 14:50:56 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:50:56 user nova-compute[75703]:     <system>
Nov 10 14:50:56 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:50:56 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:50:56 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:50:56 user nova-compute[75703]:       <entry name="serial">e01fd056-4ccd-4958-81a8-e7f3665feed1</entry>
Nov 10 14:50:56 user nova-compute[75703]:       <entry name="uuid">e01fd056-4ccd-4958-81a8-e7f3665feed1</entry>
Nov 10 14:50:56 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:50:56 user nova-compute[75703]:     </system>
Nov 10 14:50:56 user nova-compute[75703]:   </sysinfo>
Nov 10 14:50:56 user nova-compute[75703]:   <os>
Nov 10 14:50:56 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:50:56 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:50:56 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:50:56 user nova-compute[75703]:   </os>
Nov 10 14:50:56 user nova-compute[75703]:   <features>
Nov 10 14:50:56 user nova-compute[75703]:     <acpi/>
Nov 10 14:50:56 user nova-compute[75703]:     <apic/>
Nov 10 14:50:56 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:50:56 user nova-compute[75703]:   </features>
Nov 10 14:50:56 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:50:56 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:50:56 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:50:56 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:50:56 user nova-compute[75703]:   </clock>
Nov 10 14:50:56 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:50:56 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:50:56 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:50:56 user nova-compute[75703]:   </cpu>
Nov 10 14:50:56 user nova-compute[75703]:   <devices>
Nov 10 14:50:56 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:50:56 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:50:56 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk"/>
Nov 10 14:50:56 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:50:56 user nova-compute[75703]:     </disk>
Nov 10 14:50:56 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:50:56 user nova-compute[75703]:       <mac address="fa:16:3e:f7:a0:fa"/>
Nov 10 14:50:56 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:56 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:50:56 user nova-compute[75703]:       <target dev="tap839dd737-26"/>
Nov 10 14:50:56 user nova-compute[75703]:     </interface>
Nov 10 14:50:56 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:50:56 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/console.log" append="off"/>
Nov 10 14:50:56 user nova-compute[75703]:     </serial>
Nov 10 14:50:56 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:50:56 user nova-compute[75703]:     <video>
Nov 10 14:50:56 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:50:56 user nova-compute[75703]:     </video>
Nov 10 14:50:56 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:50:56 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:50:56 user nova-compute[75703]:     </rng>
Nov 10 14:50:56 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:50:56 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:50:56 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:50:56 user nova-compute[75703]:     </memballoon>
Nov 10 14:50:56 user nova-compute[75703]:   </devices>
Nov 10 14:50:56 user nova-compute[75703]: </domain>
Nov 10 14:50:56 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-810835417',display_name='tempest-TestServerVolumeAttachmentScenario-server-810835417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-810835417',id=20,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN9G0BFa2/wJI9y3fdq4+4V3mIrKzCRIk2QdKrxxdpoPgILDUxwv0/V1bsLhFYzgGX2rYy0TA6pl4iq7wIAY9KrjOAbkYj13C1kjk5M4NSRdmWOW/DuhK7LUW8eZ+2ksw==',key_name='tempest-keypair-1410498672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1449926681744a1996072effc9947b88',ramdisk_id='',reservation_id='r-u5pbvdb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1430018624',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1430018624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75341ec55afc47b89b4a56e33c0bf9e2',uuid=e01fd056-4ccd-4958-81a8-e7f3665feed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Converting VIF {"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG os_vif [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f61d8e10-81ca-5de0-8fc7-bf3d9a4c4020', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839dd737-26, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap839dd737-26, col_values=(('qos', UUID('9bd796e5-0a98-4118-9bed-6d583f634836')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap839dd737-26, col_values=(('external_ids', {'iface-id': '839dd737-26d3-4eea-9600-63d40f2e6181', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:a0:fa', 'vm-uuid': 'e01fd056-4ccd-4958-81a8-e7f3665feed1'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: INFO os_vif [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26')
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No VIF found with MAC fa:16:3e:f7:a0:fa, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:50:56 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:50:56 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: INFO nova.virt.block_device [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Booting with volume f05f4e5a-9b04-4b7b-b981-25d35ec74126 at /dev/vda
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:56 user nova-compute[75703]: DEBUG nova.policy [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea42fc2dabe447ee87fce885f5ea8beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd24267e4b564b6c9893ada44093d0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG os_brick.utils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.network.neutron [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updated VIF entry in instance network info cache for port 839dd737-26d3-4eea-9600-63d40f2e6181. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.network.neutron [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updating instance_info_cache with network_info: [{"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2b27c-e362-4b99-bbd6-e8fa3fee8377]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6070569a-47f9-49b7-a879-912de3f1f01c req-683c8d57-f829-4ff7-9c1f-015e4b9ba237 service nova] Releasing lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c31875-9fc6-4d96-ac31-678e46f4ca0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb2e0ff-2797-4c2f-9e4b-520c1dea9a89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445605f-c988-4310-a3ab-1a1960a23902]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-67d90f02-7105-46a6-bfea-5ad9742f4581 req-af8e90a4-b998-4577-b78a-6ac1a514348c service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-67d90f02-7105-46a6-bfea-5ad9742f4581 req-af8e90a4-b998-4577-b78a-6ac1a514348c service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-67d90f02-7105-46a6-bfea-5ad9742f4581 req-af8e90a4-b998-4577-b78a-6ac1a514348c service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-67d90f02-7105-46a6-bfea-5ad9742f4581 req-af8e90a4-b998-4577-b78a-6ac1a514348c service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-67d90f02-7105-46a6-bfea-5ad9742f4581 req-af8e90a4-b998-4577-b78a-6ac1a514348c service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:57 user nova-compute[75703]: WARNING nova.compute.manager [req-67d90f02-7105-46a6-bfea-5ad9742f4581 req-af8e90a4-b998-4577-b78a-6ac1a514348c service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state building and task_state spawning.
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:50:57 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e9aee-1f74-4d97-98c2-34a43a1b5b3c]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG os_brick.utils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] <== get_connector_properties: return (226ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating existing volume attachment record: f078b749-412a-451d-8f55-96909d9e5fa7 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:50:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully created port: c63a6dda-5fe5-4ce5-97b6-67188bf4c691 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating instance_info_cache with network_info: [{"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-cc2a6989-8214-499a-b2d4-b8c88225a992" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-c0e61c9e-aae8-4937-81ca-5797ba63378a req-a5526201-ee1a-4016-9be0-b10cf7ee20c4 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c0e61c9e-aae8-4937-81ca-5797ba63378a req-a5526201-ee1a-4016-9be0-b10cf7ee20c4 service nova] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c0e61c9e-aae8-4937-81ca-5797ba63378a req-a5526201-ee1a-4016-9be0-b10cf7ee20c4 service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c0e61c9e-aae8-4937-81ca-5797ba63378a req-a5526201-ee1a-4016-9be0-b10cf7ee20c4 service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-c0e61c9e-aae8-4937-81ca-5797ba63378a req-a5526201-ee1a-4016-9be0-b10cf7ee20c4 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] No waiting events found dispatching network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:59 user nova-compute[75703]: WARNING nova.compute.manager [req-c0e61c9e-aae8-4937-81ca-5797ba63378a req-a5526201-ee1a-4016-9be0-b10cf7ee20c4 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received unexpected event network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 for instance with vm_state building and task_state spawning.
Nov 10 14:50:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-999654b2-6333-44ee-94b0-6af6ed103c57 req-b940f0f8-db09-4378-8e5e-21d14c022d83 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-999654b2-6333-44ee-94b0-6af6ed103c57 req-b940f0f8-db09-4378-8e5e-21d14c022d83 service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-999654b2-6333-44ee-94b0-6af6ed103c57 req-b940f0f8-db09-4378-8e5e-21d14c022d83 service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-999654b2-6333-44ee-94b0-6af6ed103c57 req-b940f0f8-db09-4378-8e5e-21d14c022d83 service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-999654b2-6333-44ee-94b0-6af6ed103c57 req-b940f0f8-db09-4378-8e5e-21d14c022d83 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:50:59 user nova-compute[75703]: WARNING nova.compute.manager [req-999654b2-6333-44ee-94b0-6af6ed103c57 req-b940f0f8-db09-4378-8e5e-21d14c022d83 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state building and task_state spawning.
Nov 10 14:50:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully created port: 20101961-b3b6-46ac-aaef-4611110bf25e {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:50:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully created port: 434a5f4d-ff68-4dac-920d-037a9f26a86b {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:51:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully created port: 2f79f4b5-e830-4bcd-99a4-fac899aa3436 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:51:01 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance spawned successfully.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: INFO nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Took 11.16 seconds to spawn the instance on the hypervisor.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:01 user nova-compute[75703]: INFO nova.compute.manager [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Took 13.07 seconds to build instance.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cfa17bf6-a95a-4fb6-a2b2-251117836599 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.370s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully created port: 9b996e88-79ce-4f08-a398-7efec9fda4e2 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-461d375c-ac25-4cfe-94f5-d023f1076696 req-01623987-1bfa-4adf-9c76-caf89db24cbe service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-461d375c-ac25-4cfe-94f5-d023f1076696 req-01623987-1bfa-4adf-9c76-caf89db24cbe service nova] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-461d375c-ac25-4cfe-94f5-d023f1076696 req-01623987-1bfa-4adf-9c76-caf89db24cbe service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-461d375c-ac25-4cfe-94f5-d023f1076696 req-01623987-1bfa-4adf-9c76-caf89db24cbe service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-461d375c-ac25-4cfe-94f5-d023f1076696 req-01623987-1bfa-4adf-9c76-caf89db24cbe service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] No waiting events found dispatching network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:01 user nova-compute[75703]: WARNING nova.compute.manager [req-461d375c-ac25-4cfe-94f5-d023f1076696 req-01623987-1bfa-4adf-9c76-caf89db24cbe service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received unexpected event network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 for instance with vm_state building and task_state spawning.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:51:01 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Instance spawned successfully.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:01 user nova-compute[75703]: INFO nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Took 8.10 seconds to spawn the instance on the hypervisor.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:01 user nova-compute[75703]: INFO nova.compute.manager [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Took 9.40 seconds to build instance.
Nov 10 14:51:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-30a9bd2a-4991-465b-919f-6b0ec741ba8b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.586s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: c63a6dda-5fe5-4ce5-97b6-67188bf4c691 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-c63a6dda-5fe5-4ce5-97b6-67188bf4c691 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-c63a6dda-5fe5-4ce5-97b6-67188bf4c691. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port c63a6dda-5fe5-4ce5-97b6-67188bf4c691 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:02 user nova-compute[75703]: INFO nova.compute.manager [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Terminating instance
Nov 10 14:51:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-376021a9-e827-454e-9e58-7c4e6e8a3fa6 req-01a6af56-35d1-4a1d-b56b-0451c3f0919b service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: 7f34fa39-d7de-40ca-8c0d-1b54235bf7f3 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:03 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Instance destroyed successfully.
Nov 10 14:51:03 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lazy-loading 'resources' on Instance uuid cc2a6989-8214-499a-b2d4-b8c88225a992 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-3359d2b5-9465-48f7-a154-d8800aca1f16 req-14a17993-fff9-4678-81df-9f5c1e1f2ef6 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-vif-unplugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3359d2b5-9465-48f7-a154-d8800aca1f16 req-14a17993-fff9-4678-81df-9f5c1e1f2ef6 service nova] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3359d2b5-9465-48f7-a154-d8800aca1f16 req-14a17993-fff9-4678-81df-9f5c1e1f2ef6 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3359d2b5-9465-48f7-a154-d8800aca1f16 req-14a17993-fff9-4678-81df-9f5c1e1f2ef6 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-3359d2b5-9465-48f7-a154-d8800aca1f16 req-14a17993-fff9-4678-81df-9f5c1e1f2ef6 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] No waiting events found dispatching network-vif-unplugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-3359d2b5-9465-48f7-a154-d8800aca1f16 req-14a17993-fff9-4678-81df-9f5c1e1f2ef6 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-vif-unplugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-835220917',display_name='tempest-VolumesAdminNegativeTest-server-835220917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-835220917',id=6,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD94JUXU1r3/tc5xaTVXQq5JqsotB5tiHCzjth4ZgCPX27XhHl4MCra+IstaZS7UiNX2QzBpUaO4F5uhDpjDSEsvtLNuEGkLcZAoZtXlwdK5lJtNafmmlJNBqaR075wv8A==',key_name='tempest-keypair-489795493',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad107feaed514542a6e5e91073ed48f0',ramdisk_id='',reservation_id='r-q2g0jar0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-18732562',owner_user_name='tempest-VolumesAdminNegativeTest-18732562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a55f2945837465eb94a73d1399b52e8',uuid=cc2a6989-8214-499a-b2d4-b8c88225a992,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converting VIF {"id": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "address": "fa:16:3e:d4:39:ab", "network": {"id": "25b1a017-6ab0-4770-8180-64479fa0a170", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1026063967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad107feaed514542a6e5e91073ed48f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7e1e900-90", "ovs_interfaceid": "a7e1e900-9023-40fb-bb13-83b8a61c7da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG os_vif [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7e1e900-90, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c04b208a-9c01-457a-b382-3529cf6422db) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:51:04 user nova-compute[75703]: INFO os_vif [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:39:ab,bridge_name='br-int',has_traffic_filtering=True,id=a7e1e900-9023-40fb-bb13-83b8a61c7da0,network=Network(25b1a017-6ab0-4770-8180-64479fa0a170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7e1e900-90')
Nov 10 14:51:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Deleting instance files /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992_del
Nov 10 14:51:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Deletion of /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992_del complete
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json" returned: 1 in 0.261s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk --force-share --output=json' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:51:04 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/cc2a6989-8214-499a-b2d4-b8c88225a992/disk
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:51:04 user nova-compute[75703]: INFO nova.compute.manager [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.408s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-7f34fa39-d7de-40ca-8c0d-1b54235bf7f3 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-7f34fa39-d7de-40ca-8c0d-1b54235bf7f3. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.network.neutron [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port 7f34fa39-d7de-40ca-8c0d-1b54235bf7f3 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG nova.network.neutron [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG nova.network.neutron [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8432511b-f4e0-48e9-89dc-1a6b5309546d req-087d4fbc-ce15-433f-88d9-a609b02212b3 service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: ed6c7739-652a-4279-a34f-96b529fdde9c {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-8249014c-bec8-4ff7-9aee-ec18a2f895dd req-e65c4052-7360-4d47-914e-856d8a3db118 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8249014c-bec8-4ff7-9aee-ec18a2f895dd req-e65c4052-7360-4d47-914e-856d8a3db118 service nova] Acquiring lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8249014c-bec8-4ff7-9aee-ec18a2f895dd req-e65c4052-7360-4d47-914e-856d8a3db118 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8249014c-bec8-4ff7-9aee-ec18a2f895dd req-e65c4052-7360-4d47-914e-856d8a3db118 service nova] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:05 user nova-compute[75703]: DEBUG nova.compute.manager [req-8249014c-bec8-4ff7-9aee-ec18a2f895dd req-e65c4052-7360-4d47-914e-856d8a3db118 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] No waiting events found dispatching network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:05 user nova-compute[75703]: WARNING nova.compute.manager [req-8249014c-bec8-4ff7-9aee-ec18a2f895dd req-e65c4052-7360-4d47-914e-856d8a3db118 service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received unexpected event network-vif-plugged-a7e1e900-9023-40fb-bb13-83b8a61c7da0 for instance with vm_state active and task_state deleting.
Nov 10 14:51:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: 20101961-b3b6-46ac-aaef-4611110bf25e {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-ed6c7739-652a-4279-a34f-96b529fdde9c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-ed6c7739-652a-4279-a34f-96b529fdde9c. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.network.neutron [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port ed6c7739-652a-4279-a34f-96b529fdde9c {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:06 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:51:06 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=25.230560302734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:06 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Took 2.71 seconds to deallocate network for instance.
Nov 10 14:51:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.network.neutron [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance cc2a6989-8214-499a-b2d4-b8c88225a992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0b071772-83ac-4848-b735-9dcfd41ee88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e01fd056-4ccd-4958-81a8-e7f3665feed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 99322b90-f340-4d6e-9a17-037f9b3df327 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:51:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG nova.network.neutron [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3336175b-40b2-4ca9-ba74-6d61cad57e28 req-29eeb14e-d828-4dd0-9570-3598cdeee4af service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.833s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.715s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-532f69b6-5b53-4730-b9ce-773d911463d1 req-19264b81-5b7d-4dc3-b6ae-715916f6a37e service nova] [instance: cc2a6989-8214-499a-b2d4-b8c88225a992] Received event network-vif-deleted-a7e1e900-9023-40fb-bb13-83b8a61c7da0 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:08 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Deleted allocations for instance cc2a6989-8214-499a-b2d4-b8c88225a992
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: 434a5f4d-ff68-4dac-920d-037a9f26a86b {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2faf262f-aac2-4bc5-b708-0d4dfede52c7 tempest-VolumesAdminNegativeTest-18732562 tempest-VolumesAdminNegativeTest-18732562-project-member] Lock "cc2a6989-8214-499a-b2d4-b8c88225a992" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.861s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-20101961-b3b6-46ac-aaef-4611110bf25e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-20101961-b3b6-46ac-aaef-4611110bf25e. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port 20101961-b3b6-46ac-aaef-4611110bf25e {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-545dc988-b229-4fb3-a581-2df851d188f9 req-12accc6e-28e7-4405-8296-94f633d8d68c service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: 2f79f4b5-e830-4bcd-99a4-fac899aa3436 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-434a5f4d-ff68-4dac-920d-037a9f26a86b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-434a5f4d-ff68-4dac-920d-037a9f26a86b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port 434a5f4d-ff68-4dac-920d-037a9f26a86b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-2f79f4b5-e830-4bcd-99a4-fac899aa3436 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-2f79f4b5-e830-4bcd-99a4-fac899aa3436. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port 2f79f4b5-e830-4bcd-99a4-fac899aa3436 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Successfully updated port: 9b996e88-79ce-4f08-a398-7efec9fda4e2 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7daf292c-97b9-43db-a0c2-d84fb8ddcd66 req-b27fe042-4cf8-48b7-8485-ecbb2e2981c2 service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:51:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Received event network-changed-9b996e88-79ce-4f08-a398-7efec9fda4e2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing instance network info cache due to event network-changed-9b996e88-79ce-4f08-a398-7efec9fda4e2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] Acquiring lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [{"id": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "address": "fa:16:3e:2b:0e:94", "network": {"id": "e37f24a6-3642-40ec-bd33-097a0eb22e18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2013258400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a6dda-5f", "ovs_interfaceid": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "address": "fa:16:3e:e2:87:1d", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f34fa39-d7", "ovs_interfaceid": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed6c7739-652a-4279-a34f-96b529fdde9c", "address": "fa:16:3e:f4:11:08", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped6c7739-65", "ovs_interfaceid": "ed6c7739-652a-4279-a34f-96b529fdde9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20101961-b3b6-46ac-aaef-4611110bf25e", "address": "fa:16:3e:2a:bf:b7", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20101961-b3", "ovs_interfaceid": "20101961-b3b6-46ac-aaef-4611110bf25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "address": "fa:16:3e:30:89:db", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434a5f4d-ff", "ovs_interfaceid": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "address": "fa:16:3e:0f:a4:21", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79f4b5-e8", "ovs_interfaceid": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "address": "fa:16:3e:fd:0f:39", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b996e88-79", "ovs_interfaceid": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance network_info: |[{"id": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "address": "fa:16:3e:2b:0e:94", "network": {"id": "e37f24a6-3642-40ec-bd33-097a0eb22e18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2013258400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a6dda-5f", "ovs_interfaceid": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "address": "fa:16:3e:e2:87:1d", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f34fa39-d7", "ovs_interfaceid": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed6c7739-652a-4279-a34f-96b529fdde9c", "address": "fa:16:3e:f4:11:08", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped6c7739-65", "ovs_interfaceid": "ed6c7739-652a-4279-a34f-96b529fdde9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20101961-b3b6-46ac-aaef-4611110bf25e", "address": "fa:16:3e:2a:bf:b7", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20101961-b3", "ovs_interfaceid": "20101961-b3b6-46ac-aaef-4611110bf25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "address": "fa:16:3e:30:89:db", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434a5f4d-ff", "ovs_interfaceid": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "address": "fa:16:3e:0f:a4:21", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79f4b5-e8", "ovs_interfaceid": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "address": "fa:16:3e:fd:0f:39", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b996e88-79", "ovs_interfaceid": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:51:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] Acquired lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Refreshing network info cache for port 9b996e88-79ce-4f08-a398-7efec9fda4e2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updated VIF entry in instance network info cache for port 9b996e88-79ce-4f08-a398-7efec9fda4e2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:51:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [{"id": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "address": "fa:16:3e:2b:0e:94", "network": {"id": "e37f24a6-3642-40ec-bd33-097a0eb22e18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2013258400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a6dda-5f", "ovs_interfaceid": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "address": "fa:16:3e:e2:87:1d", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f34fa39-d7", "ovs_interfaceid": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed6c7739-652a-4279-a34f-96b529fdde9c", "address": "fa:16:3e:f4:11:08", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped6c7739-65", "ovs_interfaceid": "ed6c7739-652a-4279-a34f-96b529fdde9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20101961-b3b6-46ac-aaef-4611110bf25e", "address": "fa:16:3e:2a:bf:b7", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20101961-b3", "ovs_interfaceid": "20101961-b3b6-46ac-aaef-4611110bf25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "address": "fa:16:3e:30:89:db", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434a5f4d-ff", "ovs_interfaceid": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "address": "fa:16:3e:0f:a4:21", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79f4b5-e8", "ovs_interfaceid": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "address": "fa:16:3e:fd:0f:39", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b996e88-79", "ovs_interfaceid": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aa0bcd8b-0c00-4929-afc0-fe884da7aced req-29c44a25-5d3e-4336-82af-b04d0fb355be service nova] Releasing lock "refresh_cache-99322b90-f340-4d6e-9a17-037f9b3df327" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-changed-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Refreshing instance network info cache due to event network-changed-304ff27f-da87-4fb5-96ec-5725ed77ead4. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] Acquiring lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] Acquired lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Refreshing network info cache for port 304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updated VIF entry in instance network info cache for port 304ff27f-da87-4fb5-96ec-5725ed77ead4. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating instance_info_cache with network_info: [{"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-85400184-4a5d-4012-9ed2-ce15c53f6afc req-1b2dd881-ade2-407c-a9d1-c1f031552384 service nova] Releasing lock "refresh_cache-471151e9-5ab6-483e-a2fa-a32743cf8667" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:26 user nova-compute[75703]: INFO nova.compute.manager [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Rebuilding instance
Nov 10 14:51:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-33b664d5-ce3a-456f-b6cc-eb11a30942c8 req-202c3806-6d72-44d6-baea-fa32cb78a537 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-unplugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-33b664d5-ce3a-456f-b6cc-eb11a30942c8 req-202c3806-6d72-44d6-baea-fa32cb78a537 service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-33b664d5-ce3a-456f-b6cc-eb11a30942c8 req-202c3806-6d72-44d6-baea-fa32cb78a537 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-33b664d5-ce3a-456f-b6cc-eb11a30942c8 req-202c3806-6d72-44d6-baea-fa32cb78a537 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-33b664d5-ce3a-456f-b6cc-eb11a30942c8 req-202c3806-6d72-44d6-baea-fa32cb78a537 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-unplugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:26 user nova-compute[75703]: WARNING nova.compute.manager [req-33b664d5-ce3a-456f-b6cc-eb11a30942c8 req-202c3806-6d72-44d6-baea-fa32cb78a537 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-unplugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state active and task_state rebuilding.
Nov 10 14:51:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance destroyed successfully.
Nov 10 14:51:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance destroyed successfully.
Nov 10 14:51:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312694834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1896305358',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItxue1DidduH42pp9kYmPEujA4hUUQ2wFm6mS1Wiwes11rnDY7FHYVd3vWDvUqZRoIqErX6oavuWfj1PjS9sBJ+dH68+CyzFblvDHNbUAJY9b0Z2ykurlZu+u/RterZLQ==',key_name='tempest-keypair-856963120',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d148c9594bb34eba9d4f17fd50b7d70b',ramdisk_id='',reservation_id='r-xkplm0ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1261295049',owner_user_name='tempest-ServerActionsV293TestJSON-1261295049-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='989965009f8847afae4743f6cb675a5b',uuid=471151e9-5ab6-483e-a2fa-a32743cf8667,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converting VIF {"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap304ff27f-da, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0afeb90b-7616-4b79-92aa-af8924058c10) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:51:27 user nova-compute[75703]: INFO os_vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da')
Nov 10 14:51:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:51:27 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[238988ef-6ff6-4339-b43d-cc13a8c28024]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:51:27 user nova-compute[75703]: No targets found.
Nov 10 14:51:27 user nova-compute[75703]: iSNS:
Nov 10 14:51:27 user nova-compute[75703]: No targets found.
Nov 10 14:51:27 user nova-compute[75703]: STATIC:
Nov 10 14:51:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d
Nov 10 14:51:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:51:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:51:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:51:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:51:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:51:27 user nova-compute[75703]: FIRMWARE:
Nov 10 14:51:27 user nova-compute[75703]: No targets found.
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:51:27 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:51:27 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9bcd5b-83e0-4339-bda6-fcc9b3181410]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0fbc86-30e0-4bc5-9064-b595915245eb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:51:27 user nova-compute[75703]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:51:27 user nova-compute[75703]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a429eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[52912310-5860-40a9-b8da-33f5305c395f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b7c702-6151-4edf-abe1-dacea1bae1d1]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f10c0b0-6f97-4f64-b834-ebd87ec546b4]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a3f79-ccd3-46ab-89c5-071b85873ea0]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_69d7a183', '/dev/disk/by-id/scsi-1SCST_BIO69d7a183-9c8c143a66a89770', '/dev/disk/by-id/scsi-23963386331343361') {{(pid=87268) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 14:51:27 user nova-compute[75703]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_69d7a183
Nov 10 14:51:27 user nova-compute[75703]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO69d7a183-9c8c143a66a89770
Nov 10 14:51:27 user nova-compute[75703]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23963386331343361
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[86465186-bfb0-42b4-b4c7-b9df77797ddc]: (4, None) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2447e6cf-4693-4596-8b5e-4f3d05203ad0]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66372710-a219-4996-87ee-2f7f18bc8f7c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]
Nov 10 14:51:27 user nova-compute[75703]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c34259a-46e1-43e7-9baf-acec38c30d87]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== disconnect_volume: return (374ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:51:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Deleting instance files /opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667_del
Nov 10 14:51:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Deletion of /opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667_del complete
Nov 10 14:51:27 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 could not be found.
Nov 10 14:51:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:51:27 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1838bb-47fb-4f3d-b64f-63e2223590da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:51:27 user nova-compute[75703]: No targets found.
Nov 10 14:51:27 user nova-compute[75703]: iSNS:
Nov 10 14:51:27 user nova-compute[75703]: No targets found.
Nov 10 14:51:27 user nova-compute[75703]: STATIC:
Nov 10 14:51:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:51:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:51:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:51:27 user nova-compute[75703]: FIRMWARE:
Nov 10 14:51:27 user nova-compute[75703]: No targets found.
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:51:27 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:51:27 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b1aa38-543c-4bbe-ada2-699cfb579402]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5dbd79-408a-41b3-bbcc-054767297a48]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:51:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a466c280>, {}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:51:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Disconnecting from: [] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== disconnect_volume: return (72ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG nova.compute.manager [req-4b36f30c-082c-4cee-9082-8bd7f9184487 req-5a6c7017-be0c-4ba1-9b99-27a8666014a5 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4b36f30c-082c-4cee-9082-8bd7f9184487 req-5a6c7017-be0c-4ba1-9b99-27a8666014a5 service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4b36f30c-082c-4cee-9082-8bd7f9184487 req-5a6c7017-be0c-4ba1-9b99-27a8666014a5 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4b36f30c-082c-4cee-9082-8bd7f9184487 req-5a6c7017-be0c-4ba1-9b99-27a8666014a5 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:28 user nova-compute[75703]: DEBUG nova.compute.manager [req-4b36f30c-082c-4cee-9082-8bd7f9184487 req-5a6c7017-be0c-4ba1-9b99-27a8666014a5 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:28 user nova-compute[75703]: WARNING nova.compute.manager [req-4b36f30c-082c-4cee-9082-8bd7f9184487 req-5a6c7017-be0c-4ba1-9b99-27a8666014a5 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state active and task_state rebuilding.
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Preparing to wait for external event volume-reimaged-faafe044-4e14-4046-aec4-01372c02ef0d {{(pid=75703) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.volume.cinder [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Update attachment failed for attachment f078b749-412a-451d-8f55-96909d9e5fa7. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Traceback (most recent call last):
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     driver_block_device.attach_block_devices(
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     _log_and_attach(device)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     self._do_attach(context, instance, volume, volume_api,
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     self._volume_attach(context, volume, connector, instance,
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     connection_info = volume_api.attachment_update(
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     res = method(self, ctx, *args, **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     with excutils.save_and_reraise_exception():
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     self.force_reraise()
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     raise self.value
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     return method.func(obj, *args, **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     return self.request(url, method, **kwargs)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327]     raise exceptions.from_response(resp, body)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464)
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] 
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.compute.claims [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Aborting claim: <nova.compute.claims.Claim object at 0x7fb4c443d300> {{(pid=75703) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.512s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Build of instance 99322b90-f340-4d6e-9a17-037f9b3df327 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464) {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.compute.utils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Build of instance 99322b90-f340-4d6e-9a17-037f9b3df327 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75703) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 14:51:29 user nova-compute[75703]: ERROR nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Build of instance 99322b90-f340-4d6e-9a17-037f9b3df327 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464): nova.exception.BuildAbortException: Build of instance 99322b90-f340-4d6e-9a17-037f9b3df327 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1c10ed67-58ec-469f-b3b6-0b5595b7e464)
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Unplugging VIFs for instance {{(pid=75703) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "address": "fa:16:3e:2b:0e:94", "network": {"id": "e37f24a6-3642-40ec-bd33-097a0eb22e18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2013258400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a6dda-5f", "ovs_interfaceid": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "address": "fa:16:3e:2b:0e:94", "network": {"id": "e37f24a6-3642-40ec-bd33-097a0eb22e18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2013258400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63a6dda-5f", "ovs_interfaceid": "c63a6dda-5fe5-4ce5-97b6-67188bf4c691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0e:94,bridge_name='br-int',has_traffic_filtering=True,id=c63a6dda-5fe5-4ce5-97b6-67188bf4c691,network=Network(e37f24a6-3642-40ec-bd33-097a0eb22e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a6dda-5f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0e:94,bridge_name='br-int',has_traffic_filtering=True,id=c63a6dda-5fe5-4ce5-97b6-67188bf4c691,network=Network(e37f24a6-3642-40ec-bd33-097a0eb22e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a6dda-5f') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63a6dda-5f, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:29 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0e:94,bridge_name='br-int',has_traffic_filtering=True,id=c63a6dda-5fe5-4ce5-97b6-67188bf4c691,network=Network(e37f24a6-3642-40ec-bd33-097a0eb22e18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63a6dda-5f')
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "address": "fa:16:3e:e2:87:1d", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f34fa39-d7", "ovs_interfaceid": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "address": "fa:16:3e:e2:87:1d", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f34fa39-d7", "ovs_interfaceid": "7f34fa39-d7de-40ca-8c0d-1b54235bf7f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=7f34fa39-d7de-40ca-8c0d-1b54235bf7f3,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f34fa39-d7') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:29 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=7f34fa39-d7de-40ca-8c0d-1b54235bf7f3,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f34fa39-d7') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f34fa39-d7, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:30 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:87:1d,bridge_name='br-int',has_traffic_filtering=True,id=7f34fa39-d7de-40ca-8c0d-1b54235bf7f3,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f34fa39-d7')
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed6c7739-652a-4279-a34f-96b529fdde9c", "address": "fa:16:3e:f4:11:08", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped6c7739-65", "ovs_interfaceid": "ed6c7739-652a-4279-a34f-96b529fdde9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "ed6c7739-652a-4279-a34f-96b529fdde9c", "address": "fa:16:3e:f4:11:08", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped6c7739-65", "ovs_interfaceid": "ed6c7739-652a-4279-a34f-96b529fdde9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:11:08,bridge_name='br-int',has_traffic_filtering=True,id=ed6c7739-652a-4279-a34f-96b529fdde9c,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped6c7739-65') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:11:08,bridge_name='br-int',has_traffic_filtering=True,id=ed6c7739-652a-4279-a34f-96b529fdde9c,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped6c7739-65') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped6c7739-65, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:30 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:11:08,bridge_name='br-int',has_traffic_filtering=True,id=ed6c7739-652a-4279-a34f-96b529fdde9c,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped6c7739-65')
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20101961-b3b6-46ac-aaef-4611110bf25e", "address": "fa:16:3e:2a:bf:b7", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20101961-b3", "ovs_interfaceid": "20101961-b3b6-46ac-aaef-4611110bf25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "20101961-b3b6-46ac-aaef-4611110bf25e", "address": "fa:16:3e:2a:bf:b7", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20101961-b3", "ovs_interfaceid": "20101961-b3b6-46ac-aaef-4611110bf25e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:bf:b7,bridge_name='br-int',has_traffic_filtering=True,id=20101961-b3b6-46ac-aaef-4611110bf25e,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20101961-b3') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:bf:b7,bridge_name='br-int',has_traffic_filtering=True,id=20101961-b3b6-46ac-aaef-4611110bf25e,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20101961-b3') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20101961-b3, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:30 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:bf:b7,bridge_name='br-int',has_traffic_filtering=True,id=20101961-b3b6-46ac-aaef-4611110bf25e,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20101961-b3')
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "address": "fa:16:3e:30:89:db", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434a5f4d-ff", "ovs_interfaceid": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "address": "fa:16:3e:30:89:db", "network": {"id": "dbd6d81a-9618-4992-a2a6-fcf481c0db94", "bridge": "br-int", "label": "tempest-device-tagging-net1-2077510569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434a5f4d-ff", "ovs_interfaceid": "434a5f4d-ff68-4dac-920d-037a9f26a86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:89:db,bridge_name='br-int',has_traffic_filtering=True,id=434a5f4d-ff68-4dac-920d-037a9f26a86b,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434a5f4d-ff') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:89:db,bridge_name='br-int',has_traffic_filtering=True,id=434a5f4d-ff68-4dac-920d-037a9f26a86b,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434a5f4d-ff') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434a5f4d-ff, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:30 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:89:db,bridge_name='br-int',has_traffic_filtering=True,id=434a5f4d-ff68-4dac-920d-037a9f26a86b,network=Network(dbd6d81a-9618-4992-a2a6-fcf481c0db94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434a5f4d-ff')
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "address": "fa:16:3e:0f:a4:21", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79f4b5-e8", "ovs_interfaceid": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "address": "fa:16:3e:0f:a4:21", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f79f4b5-e8", "ovs_interfaceid": "2f79f4b5-e830-4bcd-99a4-fac899aa3436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a4:21,bridge_name='br-int',has_traffic_filtering=True,id=2f79f4b5-e830-4bcd-99a4-fac899aa3436,network=Network(4d195d66-7dec-410d-b859-d735143e4efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79f4b5-e8') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a4:21,bridge_name='br-int',has_traffic_filtering=True,id=2f79f4b5-e830-4bcd-99a4-fac899aa3436,network=Network(4d195d66-7dec-410d-b859-d735143e4efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79f4b5-e8') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f79f4b5-e8, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:30 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a4:21,bridge_name='br-int',has_traffic_filtering=True,id=2f79f4b5-e830-4bcd-99a4-fac899aa3436,network=Network(4d195d66-7dec-410d-b859-d735143e4efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f79f4b5-e8')
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2102604115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2102604115',id=21,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5GkfdDfXLVPfHGYC9rtjG5CiWWup5a7kOwokYDcugJKJXYVkZhJhaCJ9B36mkVD21fgxzmZ0g7yhIuhoWgfTZINn7AFaXFGM9bOJ7TnSY630rruL6MzVY9xtF8zAcuQ==',key_name='tempest-keypair-914348732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd24267e4b564b6c9893ada44093d0ba',ramdisk_id='',reservation_id='r-liyn4v0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1811773974',owner_user_name='tempest-TaggedBootDevicesTest_v242-1811773974-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea42fc2dabe447ee87fce885f5ea8beb',uuid=99322b90-f340-4d6e-9a17-037f9b3df327,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "address": "fa:16:3e:fd:0f:39", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b996e88-79", "ovs_interfaceid": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converting VIF {"id": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "address": "fa:16:3e:fd:0f:39", "network": {"id": "4d195d66-7dec-410d-b859-d735143e4efc", "bridge": "br-int", "label": "tempest-device-tagging-net2-737928190", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cd24267e4b564b6c9893ada44093d0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b996e88-79", "ovs_interfaceid": "9b996e88-79ce-4f08-a398-7efec9fda4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0f:39,bridge_name='br-int',has_traffic_filtering=True,id=9b996e88-79ce-4f08-a398-7efec9fda4e2,network=Network(4d195d66-7dec-410d-b859-d735143e4efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b996e88-79') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0f:39,bridge_name='br-int',has_traffic_filtering=True,id=9b996e88-79ce-4f08-a398-7efec9fda4e2,network=Network(4d195d66-7dec-410d-b859-d735143e4efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b996e88-79') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b996e88-79, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:30 user nova-compute[75703]: INFO os_vif [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0f:39,bridge_name='br-int',has_traffic_filtering=True,id=9b996e88-79ce-4f08-a398-7efec9fda4e2,network=Network(4d195d66-7dec-410d-b859-d735143e4efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b996e88-79')
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Unplugged VIFs for instance {{(pid=75703) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:51:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:33 user nova-compute[75703]: DEBUG nova.network.neutron [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:33 user nova-compute[75703]: INFO nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Took 3.57 seconds to deallocate network for instance.
Nov 10 14:51:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Detaching volume: f05f4e5a-9b04-4b7b-b981-25d35ec74126 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 14:51:33 user nova-compute[75703]: INFO nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Detaching volume f05f4e5a-9b04-4b7b-b981-25d35ec74126
Nov 10 14:51:33 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Skipping driver_detach during remote rebuild. {{(pid=75703) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 14:51:34 user nova-compute[75703]: WARNING nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Failed to detach volume: f05f4e5a-9b04-4b7b-b981-25d35ec74126 due to 'NoneType' object has no attribute 'devices'
Nov 10 14:51:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Detaching volume: ef1ed79e-53cb-4b44-9728-d9b33b5a97a5 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 14:51:34 user nova-compute[75703]: INFO nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Detaching volume ef1ed79e-53cb-4b44-9728-d9b33b5a97a5
Nov 10 14:51:34 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Skipping driver_detach during remote rebuild. {{(pid=75703) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 14:51:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:34 user nova-compute[75703]: WARNING nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Failed to detach volume: ef1ed79e-53cb-4b44-9728-d9b33b5a97a5 due to 'NoneType' object has no attribute 'devices'
Nov 10 14:51:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Detaching volume: 7903ad51-6eb3-4cb7-82ea-62352d8d43cc {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 14:51:34 user nova-compute[75703]: INFO nova.compute.manager [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Detaching volume 7903ad51-6eb3-4cb7-82ea-62352d8d43cc
Nov 10 14:51:34 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] [instance: 99322b90-f340-4d6e-9a17-037f9b3df327] Skipping driver_detach during remote rebuild. {{(pid=75703) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 14:51:34 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Deleted allocations for instance 99322b90-f340-4d6e-9a17-037f9b3df327
Nov 10 14:51:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-efed7621-c460-4572-8a8b-213726170b24 tempest-TaggedBootDevicesTest_v242-1811773974 tempest-TaggedBootDevicesTest_v242-1811773974-project-member] Lock "99322b90-f340-4d6e-9a17-037f9b3df327" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.048s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:51:47 user nova-compute[75703]: INFO nova.compute.claims [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Claim successful on node user
Nov 10 14:51:47 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:51:47 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:51:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.policy [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12a92500f85a405fabde541ca2f18a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d17d344f86f40bcbb293bcb8dc06fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:51:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Creating image(s)
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "/opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "/opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "/opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.223s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk 1073741824" returned: 0 in 0.061s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.229s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Successfully created port: 1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Cannot resize image /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Ensure instance console log exists: /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Successfully updated port: 1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquired lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-changed-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Refreshing instance network info cache due to event network-changed-1c43802c-661b-4562-affe-83d945c2cddf. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] Acquiring lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updating instance_info_cache with network_info: [{"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Releasing lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Instance network_info: |[{"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] Acquired lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Refreshing network info cache for port 1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Start _get_guest_xml network_info=[{"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:51:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:51:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-85769623',display_name='tempest-AttachVolumeTestJSON-server-85769623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-85769623',id=22,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeBeaPogfuFO2b73ltuJcALe7nBAq/0FBNMwRzjLn+/CzLssv3lvhQ+cFxzViJAmp2p0ZAqV2WXA2MuWcpVMk9TT0WAvs5PLxOOAYyWmRL+8VykP/9w72kh9A9xfLfhUw==',key_name='tempest-keypair-488592293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d17d344f86f40bcbb293bcb8dc06fb3',ramdisk_id='',reservation_id='r-zzmr0kqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1704980195',owner_user_name='tempest-AttachVolumeTestJSON-1704980195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12a92500f85a405fabde541ca2f18a05',uuid=5224b8c5-414d-41d5-b973-71474c10a5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converting VIF {"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'pci_devices' on Instance uuid 5224b8c5-414d-41d5-b973-71474c10a5d0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:51:51 user nova-compute[75703]:   <uuid>5224b8c5-414d-41d5-b973-71474c10a5d0</uuid>
Nov 10 14:51:51 user nova-compute[75703]:   <name>instance-00000016</name>
Nov 10 14:51:51 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:51:51 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:51:51 user nova-compute[75703]:   <metadata>
Nov 10 14:51:51 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:51:51 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:51:51 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeTestJSON-server-85769623</nova:name>
Nov 10 14:51:51 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:51:51</nova:creationTime>
Nov 10 14:51:51 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:51:51 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:51:51 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:51:51 user nova-compute[75703]:       <nova:owner>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:user uuid="12a92500f85a405fabde541ca2f18a05">tempest-AttachVolumeTestJSON-1704980195-project-member</nova:user>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:project uuid="1d17d344f86f40bcbb293bcb8dc06fb3">tempest-AttachVolumeTestJSON-1704980195</nova:project>
Nov 10 14:51:51 user nova-compute[75703]:       </nova:owner>
Nov 10 14:51:51 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:51:51 user nova-compute[75703]:       <nova:ports>
Nov 10 14:51:51 user nova-compute[75703]:         <nova:port uuid="1c43802c-661b-4562-affe-83d945c2cddf">
Nov 10 14:51:51 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:51:51 user nova-compute[75703]:         </nova:port>
Nov 10 14:51:51 user nova-compute[75703]:       </nova:ports>
Nov 10 14:51:51 user nova-compute[75703]:     </nova:instance>
Nov 10 14:51:51 user nova-compute[75703]:   </metadata>
Nov 10 14:51:51 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:51:51 user nova-compute[75703]:     <system>
Nov 10 14:51:51 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:51:51 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:51:51 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:51:51 user nova-compute[75703]:       <entry name="serial">5224b8c5-414d-41d5-b973-71474c10a5d0</entry>
Nov 10 14:51:51 user nova-compute[75703]:       <entry name="uuid">5224b8c5-414d-41d5-b973-71474c10a5d0</entry>
Nov 10 14:51:51 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:51:51 user nova-compute[75703]:     </system>
Nov 10 14:51:51 user nova-compute[75703]:   </sysinfo>
Nov 10 14:51:51 user nova-compute[75703]:   <os>
Nov 10 14:51:51 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:51:51 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:51:51 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:51:51 user nova-compute[75703]:   </os>
Nov 10 14:51:51 user nova-compute[75703]:   <features>
Nov 10 14:51:51 user nova-compute[75703]:     <acpi/>
Nov 10 14:51:51 user nova-compute[75703]:     <apic/>
Nov 10 14:51:51 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:51:51 user nova-compute[75703]:   </features>
Nov 10 14:51:51 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:51:51 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:51:51 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:51:51 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:51:51 user nova-compute[75703]:   </clock>
Nov 10 14:51:51 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:51:51 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:51:51 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:51:51 user nova-compute[75703]:   </cpu>
Nov 10 14:51:51 user nova-compute[75703]:   <devices>
Nov 10 14:51:51 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:51:51 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:51:51 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk"/>
Nov 10 14:51:51 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:51:51 user nova-compute[75703]:     </disk>
Nov 10 14:51:51 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:51:51 user nova-compute[75703]:       <mac address="fa:16:3e:95:82:c4"/>
Nov 10 14:51:51 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:51:51 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:51:51 user nova-compute[75703]:       <target dev="tap1c43802c-66"/>
Nov 10 14:51:51 user nova-compute[75703]:     </interface>
Nov 10 14:51:51 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:51:51 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/console.log" append="off"/>
Nov 10 14:51:51 user nova-compute[75703]:     </serial>
Nov 10 14:51:51 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:51:51 user nova-compute[75703]:     <video>
Nov 10 14:51:51 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:51:51 user nova-compute[75703]:     </video>
Nov 10 14:51:51 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:51:51 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:51:51 user nova-compute[75703]:     </rng>
Nov 10 14:51:51 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:51:51 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:51:51 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:51:51 user nova-compute[75703]:     </memballoon>
Nov 10 14:51:51 user nova-compute[75703]:   </devices>
Nov 10 14:51:51 user nova-compute[75703]: </domain>
Nov 10 14:51:51 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-85769623',display_name='tempest-AttachVolumeTestJSON-server-85769623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-85769623',id=22,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeBeaPogfuFO2b73ltuJcALe7nBAq/0FBNMwRzjLn+/CzLssv3lvhQ+cFxzViJAmp2p0ZAqV2WXA2MuWcpVMk9TT0WAvs5PLxOOAYyWmRL+8VykP/9w72kh9A9xfLfhUw==',key_name='tempest-keypair-488592293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d17d344f86f40bcbb293bcb8dc06fb3',ramdisk_id='',reservation_id='r-zzmr0kqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1704980195',owner_user_name='tempest-AttachVolumeTestJSON-1704980195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12a92500f85a405fabde541ca2f18a05',uuid=5224b8c5-414d-41d5-b973-71474c10a5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converting VIF {"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG os_vif [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0b218a0-6a4f-5354-ac20-169061a5751b', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c43802c-66, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c43802c-66, col_values=(('qos', UUID('97ab39a1-378a-4d09-bfac-b02beb6da4f9')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c43802c-66, col_values=(('external_ids', {'iface-id': '1c43802c-661b-4562-affe-83d945c2cddf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:82:c4', 'vm-uuid': '5224b8c5-414d-41d5-b973-71474c10a5d0'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:51 user nova-compute[75703]: INFO os_vif [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66')
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No VIF found with MAC fa:16:3e:95:82:c4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.network.neutron [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updated VIF entry in instance network info cache for port 1c43802c-661b-4562-affe-83d945c2cddf. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG nova.network.neutron [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updating instance_info_cache with network_info: [{"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:51:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-12989ac2-47df-4853-ae51-1c987d547a5e req-9d6be0cd-21c4-477b-8e31-06b7208cfc56 service nova] Releasing lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:51:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-77dc01f8-ac4c-4efe-803d-ae3e86d65920 req-59067826-5510-42cc-a256-0b8368f183e8 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-77dc01f8-ac4c-4efe-803d-ae3e86d65920 req-59067826-5510-42cc-a256-0b8368f183e8 service nova] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-77dc01f8-ac4c-4efe-803d-ae3e86d65920 req-59067826-5510-42cc-a256-0b8368f183e8 service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-77dc01f8-ac4c-4efe-803d-ae3e86d65920 req-59067826-5510-42cc-a256-0b8368f183e8 service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-77dc01f8-ac4c-4efe-803d-ae3e86d65920 req-59067826-5510-42cc-a256-0b8368f183e8 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] No waiting events found dispatching network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:53 user nova-compute[75703]: WARNING nova.compute.manager [req-77dc01f8-ac4c-4efe-803d-ae3e86d65920 req-59067826-5510-42cc-a256-0b8368f183e8 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received unexpected event network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf for instance with vm_state building and task_state spawning.
Nov 10 14:51:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:51:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Instance spawned successfully.
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:51:55 user nova-compute[75703]: INFO nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-88aa0877-15b5-49c3-a88c-06d7ffdbe9ad req-b13a8d76-0662-47ed-9b45-6ded6f8186ad service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88aa0877-15b5-49c3-a88c-06d7ffdbe9ad req-b13a8d76-0662-47ed-9b45-6ded6f8186ad service nova] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88aa0877-15b5-49c3-a88c-06d7ffdbe9ad req-b13a8d76-0662-47ed-9b45-6ded6f8186ad service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88aa0877-15b5-49c3-a88c-06d7ffdbe9ad req-b13a8d76-0662-47ed-9b45-6ded6f8186ad service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-88aa0877-15b5-49c3-a88c-06d7ffdbe9ad req-b13a8d76-0662-47ed-9b45-6ded6f8186ad service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] No waiting events found dispatching network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:51:55 user nova-compute[75703]: WARNING nova.compute.manager [req-88aa0877-15b5-49c3-a88c-06d7ffdbe9ad req-b13a8d76-0662-47ed-9b45-6ded6f8186ad service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received unexpected event network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf for instance with vm_state building and task_state spawning.
Nov 10 14:51:55 user nova-compute[75703]: INFO nova.compute.manager [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Took 7.99 seconds to build instance.
Nov 10 14:51:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-235f753f-a24b-4569-ae64-2fa6825b0cca tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.112s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:51:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:56 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:51:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:51:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:51:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:51:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:51:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:51:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:51:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:05 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:05 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.15868377685547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0b071772-83ac-4848-b735-9dcfd41ee88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e01fd056-4ccd-4958-81a8-e7f3665feed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5224b8c5-414d-41d5-b973-71474c10a5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:52:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:52:11 user nova-compute[75703]: INFO nova.compute.claims [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Claim successful on node user
Nov 10 14:52:11 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:52:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:52:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG nova.policy [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e246d79b094a4616bf66dde4c76efde1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9334d547ca014a1fa5c01aaf5df27226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:52:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Creating image(s)
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "/opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "/opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "/opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk 1073741824" returned: 0 in 0.057s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.285s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Cannot resize image /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Ensure instance console log exists: /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Successfully created port: e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Successfully updated port: e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquired lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:52:14 user nova-compute[75703]: INFO nova.compute.claims [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Claim successful on node user
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-changed-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Refreshing instance network info cache due to event network-changed-e251f077-3627-45d6-afb3-e1beec90ed70. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] Acquiring lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updating instance_info_cache with network_info: [{"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Releasing lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Instance network_info: |[{"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] Acquired lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Refreshing network info cache for port e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Start _get_guest_xml network_info=[{"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:52:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5298164',id=23,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnhcoQ/f34xJHopZSOLKLl3H/DSvTkEIui0rfmQv/8qfu7qUJKG8acw7Jb0jgKUpYB74DAyt3ZcYFzNi8s5VMrF2fD3cPoJP3E62kQka4UrPomnaDjHlmyPbe7JdT2IgQ==',key_name='tempest-keypair-1913484416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9334d547ca014a1fa5c01aaf5df27226',ramdisk_id='',reservation_id='r-69xp9pnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-162006392',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e246d79b094a4616bf66dde4c76efde1',uuid=2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Converting VIF {"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.objects.instance [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lazy-loading 'pci_devices' on Instance uuid 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:52:14 user nova-compute[75703]:   <uuid>2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5</uuid>
Nov 10 14:52:14 user nova-compute[75703]:   <name>instance-00000017</name>
Nov 10 14:52:14 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:52:14 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:52:14 user nova-compute[75703]:   <metadata>
Nov 10 14:52:14 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:52:14 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:52:14 user nova-compute[75703]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427</nova:name>
Nov 10 14:52:14 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:52:14</nova:creationTime>
Nov 10 14:52:14 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:52:14 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:52:14 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:52:14 user nova-compute[75703]:       <nova:owner>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:user uuid="e246d79b094a4616bf66dde4c76efde1">tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member</nova:user>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:project uuid="9334d547ca014a1fa5c01aaf5df27226">tempest-TestServerVolumeAttachScenarioOldVersion-162006392</nova:project>
Nov 10 14:52:14 user nova-compute[75703]:       </nova:owner>
Nov 10 14:52:14 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:52:14 user nova-compute[75703]:       <nova:ports>
Nov 10 14:52:14 user nova-compute[75703]:         <nova:port uuid="e251f077-3627-45d6-afb3-e1beec90ed70">
Nov 10 14:52:14 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:52:14 user nova-compute[75703]:         </nova:port>
Nov 10 14:52:14 user nova-compute[75703]:       </nova:ports>
Nov 10 14:52:14 user nova-compute[75703]:     </nova:instance>
Nov 10 14:52:14 user nova-compute[75703]:   </metadata>
Nov 10 14:52:14 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:52:14 user nova-compute[75703]:     <system>
Nov 10 14:52:14 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:52:14 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:52:14 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:52:14 user nova-compute[75703]:       <entry name="serial">2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5</entry>
Nov 10 14:52:14 user nova-compute[75703]:       <entry name="uuid">2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5</entry>
Nov 10 14:52:14 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:52:14 user nova-compute[75703]:     </system>
Nov 10 14:52:14 user nova-compute[75703]:   </sysinfo>
Nov 10 14:52:14 user nova-compute[75703]:   <os>
Nov 10 14:52:14 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:52:14 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:52:14 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:52:14 user nova-compute[75703]:   </os>
Nov 10 14:52:14 user nova-compute[75703]:   <features>
Nov 10 14:52:14 user nova-compute[75703]:     <acpi/>
Nov 10 14:52:14 user nova-compute[75703]:     <apic/>
Nov 10 14:52:14 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:52:14 user nova-compute[75703]:   </features>
Nov 10 14:52:14 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:52:14 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:52:14 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:52:14 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:52:14 user nova-compute[75703]:   </clock>
Nov 10 14:52:14 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:52:14 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:52:14 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:52:14 user nova-compute[75703]:   </cpu>
Nov 10 14:52:14 user nova-compute[75703]:   <devices>
Nov 10 14:52:14 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:52:14 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:52:14 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk"/>
Nov 10 14:52:14 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:52:14 user nova-compute[75703]:     </disk>
Nov 10 14:52:14 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:52:14 user nova-compute[75703]:       <mac address="fa:16:3e:28:b1:29"/>
Nov 10 14:52:14 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:14 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:52:14 user nova-compute[75703]:       <target dev="tape251f077-36"/>
Nov 10 14:52:14 user nova-compute[75703]:     </interface>
Nov 10 14:52:14 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:52:14 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/console.log" append="off"/>
Nov 10 14:52:14 user nova-compute[75703]:     </serial>
Nov 10 14:52:14 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:52:14 user nova-compute[75703]:     <video>
Nov 10 14:52:14 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:14 user nova-compute[75703]:     </video>
Nov 10 14:52:14 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:52:14 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:52:14 user nova-compute[75703]:     </rng>
Nov 10 14:52:14 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:52:14 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:52:14 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:52:14 user nova-compute[75703]:     </memballoon>
Nov 10 14:52:14 user nova-compute[75703]:   </devices>
Nov 10 14:52:14 user nova-compute[75703]: </domain>
Nov 10 14:52:14 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5298164',id=23,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnhcoQ/f34xJHopZSOLKLl3H/DSvTkEIui0rfmQv/8qfu7qUJKG8acw7Jb0jgKUpYB74DAyt3ZcYFzNi8s5VMrF2fD3cPoJP3E62kQka4UrPomnaDjHlmyPbe7JdT2IgQ==',key_name='tempest-keypair-1913484416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9334d547ca014a1fa5c01aaf5df27226',ramdisk_id='',reservation_id='r-69xp9pnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-162006392',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e246d79b094a4616bf66dde4c76efde1',uuid=2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Converting VIF {"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG os_vif [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e35d83d-5273-5afd-9d09-6eafd2a92b87', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape251f077-36, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape251f077-36, col_values=(('qos', UUID('f27c1552-738d-4006-a829-61f40f5f7e22')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape251f077-36, col_values=(('external_ids', {'iface-id': 'e251f077-3627-45d6-afb3-e1beec90ed70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:b1:29', 'vm-uuid': '2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:14 user nova-compute[75703]: INFO os_vif [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36')
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] No VIF found with MAC fa:16:3e:28:b1:29, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:52:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:52:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.policy [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90957e8164224a1285c067f0313178a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19b6b93f7b4e6dbe0ded4d084792f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:52:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Creating image(s)
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "/opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updated VIF entry in instance network info cache for port e251f077-3627-45d6-afb3-e1beec90ed70. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updating instance_info_cache with network_info: [{"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9df31c7-6c81-4e1b-a02f-2bfd77af6bf8 req-dbd1a060-d179-43c0-87ff-a312ffe95d5e service nova] Releasing lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk 1073741824" returned: 0 in 0.058s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:52:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Cannot resize image /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Ensure instance console log exists: /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Successfully created port: 5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-88894201-8d32-4a16-8928-8f82f906bcc5 req-f6951f9f-f7a5-470b-bc8d-97484a3aaeb7 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88894201-8d32-4a16-8928-8f82f906bcc5 req-f6951f9f-f7a5-470b-bc8d-97484a3aaeb7 service nova] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88894201-8d32-4a16-8928-8f82f906bcc5 req-f6951f9f-f7a5-470b-bc8d-97484a3aaeb7 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-88894201-8d32-4a16-8928-8f82f906bcc5 req-f6951f9f-f7a5-470b-bc8d-97484a3aaeb7 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-88894201-8d32-4a16-8928-8f82f906bcc5 req-f6951f9f-f7a5-470b-bc8d-97484a3aaeb7 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] No waiting events found dispatching network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:17 user nova-compute[75703]: WARNING nova.compute.manager [req-88894201-8d32-4a16-8928-8f82f906bcc5 req-f6951f9f-f7a5-470b-bc8d-97484a3aaeb7 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received unexpected event network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 for instance with vm_state building and task_state spawning.
Nov 10 14:52:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Successfully updated port: 5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-336b5283-2bc4-4509-94c7-15defa2e0a38 req-a97a0505-3be4-42cf-bda4-7f546892c64a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event volume-reimaged-faafe044-4e14-4046-aec4-01372c02ef0d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-336b5283-2bc4-4509-94c7-15defa2e0a38 req-a97a0505-3be4-42cf-bda4-7f546892c64a service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-336b5283-2bc4-4509-94c7-15defa2e0a38 req-a97a0505-3be4-42cf-bda4-7f546892c64a service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-336b5283-2bc4-4509-94c7-15defa2e0a38 req-a97a0505-3be4-42cf-bda4-7f546892c64a service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-336b5283-2bc4-4509-94c7-15defa2e0a38 req-a97a0505-3be4-42cf-bda4-7f546892c64a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Processing event volume-reimaged-faafe044-4e14-4046-aec4-01372c02ef0d {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance event wait completed in 48 seconds for volume-reimaged {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:52:17 user nova-compute[75703]: INFO nova.compute.manager [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Rescuing
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:52:18 user nova-compute[75703]: INFO nova.virt.block_device [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Booting with volume faafe044-4e14-4046-aec4-01372c02ef0d at /dev/vda
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_brick.utils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c30db7a-3057-4f2e-b16f-a14fb8d47574]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e884a2ea-b2a6-41b9-a548-2558f21cc96d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f299733-7ace-42c0-9ec8-8dac9baf71da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a03fee8-2d2b-4f5e-8d04-da6256b09b15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:52:18 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f55cbe-efce-4081-915a-80bff15349ad]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_brick.utils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating existing volume attachment record: 19e08f24-0d11-471d-bb7b-49c2778a7534 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updating instance_info_cache with network_info: [{"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Instance network_info: |[{"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Start _get_guest_xml network_info=[{"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:52:18 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:18 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2006680303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2006680303',id=24,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-mglshrcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:15Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=40bbbbf2-cfbd-4658-96e1-bbf165da94dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.objects.instance [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'pci_devices' on Instance uuid 40bbbbf2-cfbd-4658-96e1-bbf165da94dc {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:52:18 user nova-compute[75703]:   <uuid>40bbbbf2-cfbd-4658-96e1-bbf165da94dc</uuid>
Nov 10 14:52:18 user nova-compute[75703]:   <name>instance-00000018</name>
Nov 10 14:52:18 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:52:18 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:52:18 user nova-compute[75703]:   <metadata>
Nov 10 14:52:18 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:52:18 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:52:18 user nova-compute[75703]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2006680303</nova:name>
Nov 10 14:52:18 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:52:18</nova:creationTime>
Nov 10 14:52:18 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:52:18 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:52:18 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:52:18 user nova-compute[75703]:       <nova:owner>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:user uuid="90957e8164224a1285c067f0313178a2">tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member</nova:user>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:project uuid="6b19b6b93f7b4e6dbe0ded4d084792f2">tempest-ServerBootFromVolumeStableRescueTest-2023657370</nova:project>
Nov 10 14:52:18 user nova-compute[75703]:       </nova:owner>
Nov 10 14:52:18 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:52:18 user nova-compute[75703]:       <nova:ports>
Nov 10 14:52:18 user nova-compute[75703]:         <nova:port uuid="5c59212d-5578-46e9-8fc8-6370b473d081">
Nov 10 14:52:18 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 14:52:18 user nova-compute[75703]:         </nova:port>
Nov 10 14:52:18 user nova-compute[75703]:       </nova:ports>
Nov 10 14:52:18 user nova-compute[75703]:     </nova:instance>
Nov 10 14:52:18 user nova-compute[75703]:   </metadata>
Nov 10 14:52:18 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:52:18 user nova-compute[75703]:     <system>
Nov 10 14:52:18 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:52:18 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:52:18 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:52:18 user nova-compute[75703]:       <entry name="serial">40bbbbf2-cfbd-4658-96e1-bbf165da94dc</entry>
Nov 10 14:52:18 user nova-compute[75703]:       <entry name="uuid">40bbbbf2-cfbd-4658-96e1-bbf165da94dc</entry>
Nov 10 14:52:18 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:52:18 user nova-compute[75703]:     </system>
Nov 10 14:52:18 user nova-compute[75703]:   </sysinfo>
Nov 10 14:52:18 user nova-compute[75703]:   <os>
Nov 10 14:52:18 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:52:18 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:52:18 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:52:18 user nova-compute[75703]:   </os>
Nov 10 14:52:18 user nova-compute[75703]:   <features>
Nov 10 14:52:18 user nova-compute[75703]:     <acpi/>
Nov 10 14:52:18 user nova-compute[75703]:     <apic/>
Nov 10 14:52:18 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:52:18 user nova-compute[75703]:   </features>
Nov 10 14:52:18 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:52:18 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:52:18 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:52:18 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:52:18 user nova-compute[75703]:   </clock>
Nov 10 14:52:18 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:52:18 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:52:18 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:52:18 user nova-compute[75703]:   </cpu>
Nov 10 14:52:18 user nova-compute[75703]:   <devices>
Nov 10 14:52:18 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:52:18 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:52:18 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk"/>
Nov 10 14:52:18 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:52:18 user nova-compute[75703]:     </disk>
Nov 10 14:52:18 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:52:18 user nova-compute[75703]:       <mac address="fa:16:3e:c8:60:f0"/>
Nov 10 14:52:18 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:18 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:52:18 user nova-compute[75703]:       <target dev="tap5c59212d-55"/>
Nov 10 14:52:18 user nova-compute[75703]:     </interface>
Nov 10 14:52:18 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:52:18 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/console.log" append="off"/>
Nov 10 14:52:18 user nova-compute[75703]:     </serial>
Nov 10 14:52:18 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:52:18 user nova-compute[75703]:     <video>
Nov 10 14:52:18 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:18 user nova-compute[75703]:     </video>
Nov 10 14:52:18 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:52:18 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:52:18 user nova-compute[75703]:     </rng>
Nov 10 14:52:18 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:52:18 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:52:18 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:52:18 user nova-compute[75703]:     </memballoon>
Nov 10 14:52:18 user nova-compute[75703]:   </devices>
Nov 10 14:52:18 user nova-compute[75703]: </domain>
Nov 10 14:52:18 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2006680303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2006680303',id=24,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-mglshrcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:15Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=40bbbbf2-cfbd-4658-96e1-bbf165da94dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG os_vif [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66e2db0b-ea45-561c-8088-fa0c7bd58a1b', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c59212d-55, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c59212d-55, col_values=(('qos', UUID('c8bbd87c-20ef-4e1d-ae06-f74d1ad81d8f')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c59212d-55, col_values=(('external_ids', {'iface-id': '5c59212d-5578-46e9-8fc8-6370b473d081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:60:f0', 'vm-uuid': '40bbbbf2-cfbd-4658-96e1-bbf165da94dc'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:18 user nova-compute[75703]: INFO os_vif [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55')
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No VIF found with MAC fa:16:3e:c8:60:f0, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:52:18 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Instance spawned successfully.
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updating instance_info_cache with network_info: [{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:19 user nova-compute[75703]: INFO nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 10 14:52:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-changed-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Refreshing instance network info cache due to event network-changed-5c59212d-5578-46e9-8fc8-6370b473d081. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] Acquiring lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] Acquired lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Refreshing network info cache for port 5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:19 user nova-compute[75703]: INFO nova.compute.manager [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Took 7.87 seconds to build instance.
Nov 10 14:52:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c3197441-f3d7-4332-adbb-bc22f8cba95b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.007s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-47419e37-b121-4582-9be1-38a7b1b0ed18 req-c92e6538-7503-45f6-a834-aa1bad005afe service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-unplugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-47419e37-b121-4582-9be1-38a7b1b0ed18 req-c92e6538-7503-45f6-a834-aa1bad005afe service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-47419e37-b121-4582-9be1-38a7b1b0ed18 req-c92e6538-7503-45f6-a834-aa1bad005afe service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-47419e37-b121-4582-9be1-38a7b1b0ed18 req-c92e6538-7503-45f6-a834-aa1bad005afe service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-47419e37-b121-4582-9be1-38a7b1b0ed18 req-c92e6538-7503-45f6-a834-aa1bad005afe service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-unplugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:19 user nova-compute[75703]: WARNING nova.compute.manager [req-47419e37-b121-4582-9be1-38a7b1b0ed18 req-c92e6538-7503-45f6-a834-aa1bad005afe service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-unplugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state active and task_state rescuing.
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updated VIF entry in instance network info cache for port 5c59212d-5578-46e9-8fc8-6370b473d081. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updating instance_info_cache with network_info: [{"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] Releasing lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] No waiting events found dispatching network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:20 user nova-compute[75703]: WARNING nova.compute.manager [req-b9aade40-8066-4909-b7ac-30338d40aa1e req-7b0d6bcb-aca7-40af-b8bc-114ddb1d30b6 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received unexpected event network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 for instance with vm_state building and task_state spawning.
Nov 10 14:52:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance destroyed successfully.
Nov 10 14:52:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Attempting rescue
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75703) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 14:52:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Creating image(s)
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'trusted_certs' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.267s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue" returned: 0 in 0.062s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'migration_context' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.base [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<570421c8-0cd6-48fa-b3ee-87e60ac9e8df> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Start _get_guest_xml network_info=[{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:07:fe:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'resources' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.base [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<570421c8-0cd6-48fa-b3ee-87e60ac9e8df> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'numa_topology' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.base [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<570421c8-0cd6-48fa-b3ee-87e60ac9e8df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:52:20 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:20 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'vcpu_model' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:20 user nova-compute[75703]: DEBUG nova.objects.base [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<570421c8-0cd6-48fa-b3ee-87e60ac9e8df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1275294798',display_name='tempest-ServerRescueNegativeTestJSON-server-1275294798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1275294798',id=18,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-w7jqnks9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:39Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=570421c8-0cd6-48fa-b3ee-87e60ac9e8df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:07:fe:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:07:fe:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'pci_devices' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.objects.base [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<570421c8-0cd6-48fa-b3ee-87e60ac9e8df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:52:21 user nova-compute[75703]:   <uuid>570421c8-0cd6-48fa-b3ee-87e60ac9e8df</uuid>
Nov 10 14:52:21 user nova-compute[75703]:   <name>instance-00000012</name>
Nov 10 14:52:21 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:52:21 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:52:21 user nova-compute[75703]:   <metadata>
Nov 10 14:52:21 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:52:21 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:52:21 user nova-compute[75703]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1275294798</nova:name>
Nov 10 14:52:21 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:52:20</nova:creationTime>
Nov 10 14:52:21 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:52:21 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:52:21 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:52:21 user nova-compute[75703]:       <nova:owner>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:user uuid="6b7b8488f5964719b7b47ac4416c59ea">tempest-ServerRescueNegativeTestJSON-1926780524-project-member</nova:user>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:project uuid="5703fd918f4547218ac7ef97d6b1bbdc">tempest-ServerRescueNegativeTestJSON-1926780524</nova:project>
Nov 10 14:52:21 user nova-compute[75703]:       </nova:owner>
Nov 10 14:52:21 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:52:21 user nova-compute[75703]:       <nova:ports>
Nov 10 14:52:21 user nova-compute[75703]:         <nova:port uuid="f93fde13-7f17-4094-a51c-374930061948">
Nov 10 14:52:21 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 14:52:21 user nova-compute[75703]:         </nova:port>
Nov 10 14:52:21 user nova-compute[75703]:       </nova:ports>
Nov 10 14:52:21 user nova-compute[75703]:     </nova:instance>
Nov 10 14:52:21 user nova-compute[75703]:   </metadata>
Nov 10 14:52:21 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:52:21 user nova-compute[75703]:     <system>
Nov 10 14:52:21 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:52:21 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:52:21 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:52:21 user nova-compute[75703]:       <entry name="serial">570421c8-0cd6-48fa-b3ee-87e60ac9e8df</entry>
Nov 10 14:52:21 user nova-compute[75703]:       <entry name="uuid">570421c8-0cd6-48fa-b3ee-87e60ac9e8df</entry>
Nov 10 14:52:21 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:52:21 user nova-compute[75703]:     </system>
Nov 10 14:52:21 user nova-compute[75703]:   </sysinfo>
Nov 10 14:52:21 user nova-compute[75703]:   <os>
Nov 10 14:52:21 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:52:21 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:52:21 user nova-compute[75703]:   </os>
Nov 10 14:52:21 user nova-compute[75703]:   <features>
Nov 10 14:52:21 user nova-compute[75703]:     <acpi/>
Nov 10 14:52:21 user nova-compute[75703]:     <apic/>
Nov 10 14:52:21 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:52:21 user nova-compute[75703]:   </features>
Nov 10 14:52:21 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:52:21 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:52:21 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:52:21 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:52:21 user nova-compute[75703]:   </clock>
Nov 10 14:52:21 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:52:21 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:52:21 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:52:21 user nova-compute[75703]:   </cpu>
Nov 10 14:52:21 user nova-compute[75703]:   <devices>
Nov 10 14:52:21 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:52:21 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:52:21 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue"/>
Nov 10 14:52:21 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:52:21 user nova-compute[75703]:     </disk>
Nov 10 14:52:21 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:52:21 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:52:21 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk"/>
Nov 10 14:52:21 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:52:21 user nova-compute[75703]:     </disk>
Nov 10 14:52:21 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:52:21 user nova-compute[75703]:       <mac address="fa:16:3e:07:fe:81"/>
Nov 10 14:52:21 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:21 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:52:21 user nova-compute[75703]:       <target dev="tapf93fde13-7f"/>
Nov 10 14:52:21 user nova-compute[75703]:     </interface>
Nov 10 14:52:21 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:52:21 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/console.log" append="off"/>
Nov 10 14:52:21 user nova-compute[75703]:     </serial>
Nov 10 14:52:21 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:52:21 user nova-compute[75703]:     <video>
Nov 10 14:52:21 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:21 user nova-compute[75703]:     </video>
Nov 10 14:52:21 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:52:21 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:52:21 user nova-compute[75703]:     </rng>
Nov 10 14:52:21 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:52:21 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:52:21 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:52:21 user nova-compute[75703]:     </memballoon>
Nov 10 14:52:21 user nova-compute[75703]:   </devices>
Nov 10 14:52:21 user nova-compute[75703]: </domain>
Nov 10 14:52:21 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:52:21 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance destroyed successfully.
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:07:fe:81, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:21 user nova-compute[75703]: WARNING nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state active and task_state rescuing.
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] No waiting events found dispatching network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:21 user nova-compute[75703]: WARNING nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received unexpected event network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 for instance with vm_state building and task_state spawning.
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] No waiting events found dispatching network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:21 user nova-compute[75703]: WARNING nova.compute.manager [req-9d9fc6d9-a085-40b2-9a07-8900c492a2a8 req-032065f7-866f-48de-aa81-ce1cdbeaca9d service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received unexpected event network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 for instance with vm_state building and task_state spawning.
Nov 10 14:52:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:52:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Instance spawned successfully.
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:23 user nova-compute[75703]: INFO nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Took 8.17 seconds to spawn the instance on the hypervisor.
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:23 user nova-compute[75703]: INFO nova.compute.manager [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Took 9.29 seconds to build instance.
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3c1dd408-6380-4449-9347-932a54babb27 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.415s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:23 user nova-compute[75703]: WARNING nova.compute.manager [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state active and task_state rescuing.
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:23 user nova-compute[75703]: WARNING nova.compute.manager [req-2e094d51-ca52-4e48-bb63-3163eb646857 req-9cabc226-fdc2-4668-a0c5-6cd95c007386 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state active and task_state rescuing.
Nov 10 14:52:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9f0e3f74-ee9c-4e3d-91d3-eda74c35ca25 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:52:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:52:36 user nova-compute[75703]: INFO nova.compute.claims [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Claim successful on node user
Nov 10 14:52:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:37 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:52:37 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:52:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:52:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:52:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:52:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:52:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG nova.policy [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b78d2e0b1bcb4f8f988203951bee984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53005799e814ffaa5cbf22041cfe1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:52:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Creating image(s)
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.125s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.253s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-changed-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Refreshing instance network info cache due to event network-changed-3d2f146b-0393-4de8-9e6a-196f466b3872. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] Acquiring lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] Acquired lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Refreshing network info cache for port 3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk 1073741824" returned: 0 in 0.099s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Successfully created port: 47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Cannot resize image /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Ensure instance console log exists: /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'flavor' on Instance uuid 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updated VIF entry in instance network info cache for port 3d2f146b-0393-4de8-9e6a-196f466b3872. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating instance_info_cache with network_info: [{"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3d9c04bf-692e-48a2-a5b3-999cd10a1a24 req-6c81b2b0-da2b-4aa0-8910-518a0b3a2be2 service nova] Releasing lock "refresh_cache-0b071772-83ac-4848-b735-9dcfd41ee88a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:39 user nova-compute[75703]: INFO nova.compute.manager [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attaching volume ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 to /dev/vdb
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_brick.utils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa54f3a-0570-439b-bd38-647baa611e23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c203167-da52-4801-a12f-d84416f28315]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74e29c-ee44-4da8-9746-873f6ec4442d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8e781c-78e9-418f-8f4f-1d448c4f70b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:52:40 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c298a2e-1e8a-4e1c-a954-c9af5a24a51c]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Successfully updated port: 47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_brick.utils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating existing volume attachment record: a4cef7e0-4d53-465e-8a8f-e17a756c94e1 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquired lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-changed-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Refreshing instance network info cache due to event network-changed-47551cdd-8e4e-4435-937a-697529c6f13b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] Acquiring lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Releasing lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Instance network_info: |[{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] Acquired lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Refreshing network info cache for port 47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Start _get_guest_xml network_info=[{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:52:40 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:40 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.objects.instance [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'pci_devices' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:52:40 user nova-compute[75703]:   <uuid>408dc601-9a7e-4af4-ba22-48c3d54eb66f</uuid>
Nov 10 14:52:40 user nova-compute[75703]:   <name>instance-00000019</name>
Nov 10 14:52:40 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:52:40 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:52:40 user nova-compute[75703]:   <metadata>
Nov 10 14:52:40 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:52:40 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:52:40 user nova-compute[75703]:       <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:52:40 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:52:40</nova:creationTime>
Nov 10 14:52:40 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:52:40 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:52:40 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:52:40 user nova-compute[75703]:       <nova:owner>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:52:40 user nova-compute[75703]:       </nova:owner>
Nov 10 14:52:40 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:52:40 user nova-compute[75703]:       <nova:ports>
Nov 10 14:52:40 user nova-compute[75703]:         <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:52:40 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:52:40 user nova-compute[75703]:         </nova:port>
Nov 10 14:52:40 user nova-compute[75703]:       </nova:ports>
Nov 10 14:52:40 user nova-compute[75703]:     </nova:instance>
Nov 10 14:52:40 user nova-compute[75703]:   </metadata>
Nov 10 14:52:40 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:52:40 user nova-compute[75703]:     <system>
Nov 10 14:52:40 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:52:40 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:52:40 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:52:40 user nova-compute[75703]:       <entry name="serial">408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:52:40 user nova-compute[75703]:       <entry name="uuid">408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:52:40 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:52:40 user nova-compute[75703]:     </system>
Nov 10 14:52:40 user nova-compute[75703]:   </sysinfo>
Nov 10 14:52:40 user nova-compute[75703]:   <os>
Nov 10 14:52:40 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:52:40 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:52:40 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:52:40 user nova-compute[75703]:   </os>
Nov 10 14:52:40 user nova-compute[75703]:   <features>
Nov 10 14:52:40 user nova-compute[75703]:     <acpi/>
Nov 10 14:52:40 user nova-compute[75703]:     <apic/>
Nov 10 14:52:40 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:52:40 user nova-compute[75703]:   </features>
Nov 10 14:52:40 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:52:40 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:52:40 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:52:40 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:52:40 user nova-compute[75703]:   </clock>
Nov 10 14:52:40 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:52:40 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:52:40 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:52:40 user nova-compute[75703]:   </cpu>
Nov 10 14:52:40 user nova-compute[75703]:   <devices>
Nov 10 14:52:40 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:52:40 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:52:40 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk"/>
Nov 10 14:52:40 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:52:40 user nova-compute[75703]:     </disk>
Nov 10 14:52:40 user nova-compute[75703]:     <disk type="file" device="cdrom">
Nov 10 14:52:40 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 14:52:40 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config"/>
Nov 10 14:52:40 user nova-compute[75703]:       <target dev="hda" bus="ide"/>
Nov 10 14:52:40 user nova-compute[75703]:     </disk>
Nov 10 14:52:40 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:52:40 user nova-compute[75703]:       <mac address="fa:16:3e:62:33:07"/>
Nov 10 14:52:40 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:40 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:52:40 user nova-compute[75703]:       <target dev="tap47551cdd-8e"/>
Nov 10 14:52:40 user nova-compute[75703]:     </interface>
Nov 10 14:52:40 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:52:40 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log" append="off"/>
Nov 10 14:52:40 user nova-compute[75703]:     </serial>
Nov 10 14:52:40 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:52:40 user nova-compute[75703]:     <video>
Nov 10 14:52:40 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:40 user nova-compute[75703]:     </video>
Nov 10 14:52:40 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:52:40 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:52:40 user nova-compute[75703]:     </rng>
Nov 10 14:52:40 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:52:40 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:52:40 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:52:40 user nova-compute[75703]:     </memballoon>
Nov 10 14:52:40 user nova-compute[75703]:   </devices>
Nov 10 14:52:40 user nova-compute[75703]: </domain>
Nov 10 14:52:40 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG os_vif [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf1cd735-b29f-5f3f-9335-9b903b1d7b1b', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47551cdd-8e, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47551cdd-8e, col_values=(('qos', UUID('40833dcb-99d4-44b3-a450-bedd34e17390')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47551cdd-8e, col_values=(('external_ids', {'iface-id': '47551cdd-8e4e-4435-937a-697529c6f13b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:33:07', 'vm-uuid': '408dc601-9a7e-4af4-ba22-48c3d54eb66f'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:40 user nova-compute[75703]: INFO os_vif [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e')
Nov 10 14:52:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No BDM found with device name hda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No VIF found with MAC fa:16:3e:62:33:07, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:52:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Using config drive
Nov 10 14:52:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Creating config drive at /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config
Nov 10 14:52:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprptj7mc2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG nova.network.neutron [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updated VIF entry in instance network info cache for port 47551cdd-8e4e-4435-937a-697529c6f13b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG nova.network.neutron [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprptj7mc2" returned: 0 in 0.083s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-606aa11d-de62-47aa-ba05-e92c15ef1a62 req-6ca0c184-1f29-4e4f-a4fa-f3dfce14f266 service nova] Releasing lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:52:42 user nova-compute[75703]: INFO nova.compute.claims [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Claim successful on node user
Nov 10 14:52:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-e2d600ec-777b-4077-ade4-99b1bdd780b4 req-ab318e4c-27c4-4480-a677-d63b51a26a99 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e2d600ec-777b-4077-ade4-99b1bdd780b4 req-ab318e4c-27c4-4480-a677-d63b51a26a99 service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e2d600ec-777b-4077-ade4-99b1bdd780b4 req-ab318e4c-27c4-4480-a677-d63b51a26a99 service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e2d600ec-777b-4077-ade4-99b1bdd780b4 req-ab318e4c-27c4-4480-a677-d63b51a26a99 service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-e2d600ec-777b-4077-ade4-99b1bdd780b4 req-ab318e4c-27c4-4480-a677-d63b51a26a99 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:43 user nova-compute[75703]: WARNING nova.compute.manager [req-e2d600ec-777b-4077-ade4-99b1bdd780b4 req-ab318e4c-27c4-4480-a677-d63b51a26a99 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b for instance with vm_state building and task_state spawning.
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.863s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-changed-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Refreshing instance network info cache due to event network-changed-839dd737-26d3-4eea-9600-63d40f2e6181. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] Acquiring lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] Acquired lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.network.neutron [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Refreshing network info cache for port 839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:52:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.policy [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbf6ec70894948e4886371fc014fc732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22eaeb977349819aabde01a3b34930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:52:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Creating image(s)
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "ceadb2b97d087b139f85e67e54d234e464554889" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "ceadb2b97d087b139f85e67e54d234e464554889" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG nova.virt.images [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] 5f634226-1552-4731-bfa4-dbb7e36bc0be was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.part /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updated VIF entry in instance network info cache for port 839dd737-26d3-4eea-9600-63d40f2e6181. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updating instance_info_cache with network_info: [{"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9059dcb4-5514-4865-b9c8-cea7d5029cc8 req-d959c915-c726-45be-ad94-cbf4c91ac0d9 service nova] Releasing lock "refresh_cache-e01fd056-4ccd-4958-81a8-e7f3665feed1" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.part /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.converted" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Successfully created port: 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG nova.objects.instance [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'flavor' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "ceadb2b97d087b139f85e67e54d234e464554889" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.065s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:45 user nova-compute[75703]: INFO nova.compute.manager [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attaching volume ffc0405b-74f7-4932-b962-84cdd2249694 to /dev/vdb
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json" returned: 0 in 0.256s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "ceadb2b97d087b139f85e67e54d234e464554889" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "ceadb2b97d087b139f85e67e54d234e464554889" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-f8eea794-7b5b-4e67-9aca-287dc3c8f565 req-99114ee8-939e-4a9f-9605-6ad18356d7ed service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f8eea794-7b5b-4e67-9aca-287dc3c8f565 req-99114ee8-939e-4a9f-9605-6ad18356d7ed service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f8eea794-7b5b-4e67-9aca-287dc3c8f565 req-99114ee8-939e-4a9f-9605-6ad18356d7ed service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f8eea794-7b5b-4e67-9aca-287dc3c8f565 req-99114ee8-939e-4a9f-9605-6ad18356d7ed service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.compute.manager [req-f8eea794-7b5b-4e67-9aca-287dc3c8f565 req-99114ee8-939e-4a9f-9605-6ad18356d7ed service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:45 user nova-compute[75703]: WARNING nova.compute.manager [req-f8eea794-7b5b-4e67-9aca-287dc3c8f565 req-99114ee8-939e-4a9f-9605-6ad18356d7ed service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b for instance with vm_state building and task_state spawning.
Nov 10 14:52:45 user nova-compute[75703]: DEBUG os_brick.utils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[02014639-9c37-4d4d-872e-fe9aa85fbe22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163ef59-6efd-4674-9b07-2525efae0221]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef478ef-53ec-498d-8e1d-19e84c55ee35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cee3de5-3865-4278-a24e-c0a69460feca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:52:45 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a00fa3-06eb-4e93-896a-b83a3be5301c]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG os_brick.utils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updating existing volume attachment record: 41a13f04-195c-4abb-89ef-c65332f3b205 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889,backing_fmt=raw /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:52:45 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Instance spawned successfully.
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889,backing_fmt=raw /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk 1073741824" returned: 0 in 0.068s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "ceadb2b97d087b139f85e67e54d234e464554889" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:45 user nova-compute[75703]: INFO nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Took 7.64 seconds to spawn the instance on the hypervisor.
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Successfully updated port: 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:52:45 user nova-compute[75703]: INFO nova.compute.manager [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Took 8.95 seconds to build instance.
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:52:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf161e2c-a531-4d0d-b36b-b107e5c79489 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.196s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Cannot resize image /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Ensure instance console log exists: /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance network_info: |[{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Start _get_guest_xml network_info=[{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:52:39Z,direct_url=<?>,disk_format='qcow2',id=5f634226-1552-4731-bfa4-dbb7e36bc0be,min_disk=0,min_ram=0,name='tempest-scenario-img--1416227710',owner='6b22eaeb977349819aabde01a3b34930',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:52:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '5f634226-1552-4731-bfa4-dbb7e36bc0be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:52:46 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:46 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:52:39Z,direct_url=<?>,disk_format='qcow2',id=5f634226-1552-4731-bfa4-dbb7e36bc0be,min_disk=0,min_ram=0,name='tempest-scenario-img--1416227710',owner='6b22eaeb977349819aabde01a3b34930',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:52:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754884787',display_name='tempest-TestMinimumBasicScenario-server-754884787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754884787',id=26,image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCoLe9RFklcjNxsU1qMot0dyDlwkLe2Rugi+GRQW5T7to0FacTYosg0vCSAi82F3yNDq7XI/pSwICc5y/1Kcb/cUnCv8wt8ymoD7EvlN2E6eKZfhsv20mvUzLAjHdI01Q==',key_name='tempest-TestMinimumBasicScenario-543665677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-d90rcwao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:44Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=0870c08a-f3dc-4299-aa98-b509d3cea1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'pci_devices' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:52:46 user nova-compute[75703]:   <uuid>0870c08a-f3dc-4299-aa98-b509d3cea1e8</uuid>
Nov 10 14:52:46 user nova-compute[75703]:   <name>instance-0000001a</name>
Nov 10 14:52:46 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:52:46 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:52:46 user nova-compute[75703]:   <metadata>
Nov 10 14:52:46 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:52:46 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:52:46 user nova-compute[75703]:       <nova:name>tempest-TestMinimumBasicScenario-server-754884787</nova:name>
Nov 10 14:52:46 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:52:46</nova:creationTime>
Nov 10 14:52:46 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:52:46 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:52:46 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:52:46 user nova-compute[75703]:       <nova:owner>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:user uuid="bbf6ec70894948e4886371fc014fc732">tempest-TestMinimumBasicScenario-700348367-project-member</nova:user>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:project uuid="6b22eaeb977349819aabde01a3b34930">tempest-TestMinimumBasicScenario-700348367</nova:project>
Nov 10 14:52:46 user nova-compute[75703]:       </nova:owner>
Nov 10 14:52:46 user nova-compute[75703]:       <nova:root type="image" uuid="5f634226-1552-4731-bfa4-dbb7e36bc0be"/>
Nov 10 14:52:46 user nova-compute[75703]:       <nova:ports>
Nov 10 14:52:46 user nova-compute[75703]:         <nova:port uuid="66335289-4294-4845-9d74-0111f74eb8f2">
Nov 10 14:52:46 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:52:46 user nova-compute[75703]:         </nova:port>
Nov 10 14:52:46 user nova-compute[75703]:       </nova:ports>
Nov 10 14:52:46 user nova-compute[75703]:     </nova:instance>
Nov 10 14:52:46 user nova-compute[75703]:   </metadata>
Nov 10 14:52:46 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:52:46 user nova-compute[75703]:     <system>
Nov 10 14:52:46 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:52:46 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:52:46 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:52:46 user nova-compute[75703]:       <entry name="serial">0870c08a-f3dc-4299-aa98-b509d3cea1e8</entry>
Nov 10 14:52:46 user nova-compute[75703]:       <entry name="uuid">0870c08a-f3dc-4299-aa98-b509d3cea1e8</entry>
Nov 10 14:52:46 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:52:46 user nova-compute[75703]:     </system>
Nov 10 14:52:46 user nova-compute[75703]:   </sysinfo>
Nov 10 14:52:46 user nova-compute[75703]:   <os>
Nov 10 14:52:46 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:52:46 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:52:46 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:52:46 user nova-compute[75703]:   </os>
Nov 10 14:52:46 user nova-compute[75703]:   <features>
Nov 10 14:52:46 user nova-compute[75703]:     <acpi/>
Nov 10 14:52:46 user nova-compute[75703]:     <apic/>
Nov 10 14:52:46 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:52:46 user nova-compute[75703]:   </features>
Nov 10 14:52:46 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:52:46 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:52:46 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:52:46 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:52:46 user nova-compute[75703]:   </clock>
Nov 10 14:52:46 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:52:46 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:52:46 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:52:46 user nova-compute[75703]:   </cpu>
Nov 10 14:52:46 user nova-compute[75703]:   <devices>
Nov 10 14:52:46 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:52:46 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:52:46 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk"/>
Nov 10 14:52:46 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:52:46 user nova-compute[75703]:     </disk>
Nov 10 14:52:46 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:52:46 user nova-compute[75703]:       <mac address="fa:16:3e:dc:3b:b9"/>
Nov 10 14:52:46 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:46 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:52:46 user nova-compute[75703]:       <target dev="tap66335289-42"/>
Nov 10 14:52:46 user nova-compute[75703]:     </interface>
Nov 10 14:52:46 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:52:46 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/console.log" append="off"/>
Nov 10 14:52:46 user nova-compute[75703]:     </serial>
Nov 10 14:52:46 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:52:46 user nova-compute[75703]:     <video>
Nov 10 14:52:46 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:46 user nova-compute[75703]:     </video>
Nov 10 14:52:46 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:52:46 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:52:46 user nova-compute[75703]:     </rng>
Nov 10 14:52:46 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:52:46 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:52:46 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:52:46 user nova-compute[75703]:     </memballoon>
Nov 10 14:52:46 user nova-compute[75703]:   </devices>
Nov 10 14:52:46 user nova-compute[75703]: </domain>
Nov 10 14:52:46 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754884787',display_name='tempest-TestMinimumBasicScenario-server-754884787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754884787',id=26,image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCoLe9RFklcjNxsU1qMot0dyDlwkLe2Rugi+GRQW5T7to0FacTYosg0vCSAi82F3yNDq7XI/pSwICc5y/1Kcb/cUnCv8wt8ymoD7EvlN2E6eKZfhsv20mvUzLAjHdI01Q==',key_name='tempest-TestMinimumBasicScenario-543665677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-d90rcwao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:44Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=0870c08a-f3dc-4299-aa98-b509d3cea1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG os_vif [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62fab850-475e-5eb4-85ca-83855b487cb4', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66335289-42, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66335289-42, col_values=(('qos', UUID('9b4dd7aa-4c8e-4497-a08b-e42f2d988eb7')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66335289-42, col_values=(('external_ids', {'iface-id': '66335289-4294-4845-9d74-0111f74eb8f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:3b:b9', 'vm-uuid': '0870c08a-f3dc-4299-aa98-b509d3cea1e8'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:46 user nova-compute[75703]: INFO os_vif [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42')
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No VIF found with MAC fa:16:3e:dc:3b:b9, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:52:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-changed-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing instance network info cache due to event network-changed-66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:52:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:52:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:52:47 user nova-compute[75703]: DEBUG nova.network.neutron [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:52:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.network.neutron [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updated VIF entry in instance network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.network.neutron [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd29fe7a-fc66-4721-a19d-e23704b20b31 req-fa8ba4de-2971-4377-8f0e-528300018060 service nova] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:52:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Creating image(s)
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Ensure instance console log exists: /opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Start _get_guest_xml network_info=[{"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '19e08f24-0d11-471d-bb7b-49c2778a7534', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '471151e9-5ab6-483e-a2fa-a32743cf8667', 'attached_at': '', 'detached_at': '', 'volume_id': 'faafe044-4e14-4046-aec4-01372c02ef0d', 'serial': 'faafe044-4e14-4046-aec4-01372c02ef0d'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:52:48 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 14:52:48 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.objects.instance [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 471151e9-5ab6-483e-a2fa-a32743cf8667 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:52:48 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:52:48 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:52:48 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7333b85-ac05-4504-9442-3e1364527c1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:52:48 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7032c422-8717-4e17-bafb-4c187399c587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d] added
Nov 10 14:52:48 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0bdc2-a0a7-4889-a534-fce6b43f13cc]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e367589-cf50-4970-a322-f8128dac34c8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHJBhkya {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-762a4184-9e85-49d1-90e8-8aa47b4ae359 req-fdfd9deb-5d3c-4c09-96b3-9cd684cfeb83 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-762a4184-9e85-49d1-90e8-8aa47b4ae359 req-fdfd9deb-5d3c-4c09-96b3-9cd684cfeb83 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-762a4184-9e85-49d1-90e8-8aa47b4ae359 req-fdfd9deb-5d3c-4c09-96b3-9cd684cfeb83 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-762a4184-9e85-49d1-90e8-8aa47b4ae359 req-fdfd9deb-5d3c-4c09-96b3-9cd684cfeb83 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-762a4184-9e85-49d1-90e8-8aa47b4ae359 req-fdfd9deb-5d3c-4c09-96b3-9cd684cfeb83 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:48 user nova-compute[75703]: WARNING nova.compute.manager [req-762a4184-9e85-49d1-90e8-8aa47b4ae359 req-fdfd9deb-5d3c-4c09-96b3-9cd684cfeb83 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state building and task_state spawning.
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHJBhkya" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45df29a-e5ca-4557-b458-2469eaa988f1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHJBhkya'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d4e17-f38f-45fd-8dc4-0e9e0a88acf6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6420b9eb-cb8a-4249-b136-6fab98decc9e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:52:48 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:52:48 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a3d912-3109-415a-9f3e-d3b7a06a57c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]
Nov 10 14:52:48 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.
Nov 10 14:52:48 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5285f3f1-63f5-40c9-9c15-db4f1a3fc397]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f91275-b5ca-446d-a2a4-23afbe01de04]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:52:48 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:52:48 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:52:48 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:52:48 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[009e2240-50cd-42c2-a824-21da7ab1d642]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:52:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23963386331343361', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963386331343361', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T14:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312694834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1896305358',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItxue1DidduH42pp9kYmPEujA4hUUQ2wFm6mS1Wiwes11rnDY7FHYVd3vWDvUqZRoIqErX6oavuWfj1PjS9sBJ+dH68+CyzFblvDHNbUAJY9b0Z2ykurlZu+u/RterZLQ==',key_name='tempest-keypair-856963120',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d148c9594bb34eba9d4f17fd50b7d70b',ramdisk_id='',reservation_id='r-xkplm0ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1261295049',owner_user_name='tempest-ServerActionsV293TestJSON-1261295049-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='989965009f8847afae4743f6cb675a5b',uuid=471151e9-5ab6-483e-a2fa-a32743cf8667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converting VIF {"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:52:49 user nova-compute[75703]:   <uuid>471151e9-5ab6-483e-a2fa-a32743cf8667</uuid>
Nov 10 14:52:49 user nova-compute[75703]:   <name>instance-00000010</name>
Nov 10 14:52:49 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:52:49 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:52:49 user nova-compute[75703]:   <metadata>
Nov 10 14:52:49 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:52:49 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:52:49 user nova-compute[75703]:       <nova:name>tempest-ServerActionsV293TestJSON-server-312694834</nova:name>
Nov 10 14:52:49 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:52:48</nova:creationTime>
Nov 10 14:52:49 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:52:49 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:52:49 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:52:49 user nova-compute[75703]:       <nova:owner>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:user uuid="989965009f8847afae4743f6cb675a5b">tempest-ServerActionsV293TestJSON-1261295049-project-member</nova:user>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:project uuid="d148c9594bb34eba9d4f17fd50b7d70b">tempest-ServerActionsV293TestJSON-1261295049</nova:project>
Nov 10 14:52:49 user nova-compute[75703]:       </nova:owner>
Nov 10 14:52:49 user nova-compute[75703]:       <nova:ports>
Nov 10 14:52:49 user nova-compute[75703]:         <nova:port uuid="304ff27f-da87-4fb5-96ec-5725ed77ead4">
Nov 10 14:52:49 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 14:52:49 user nova-compute[75703]:         </nova:port>
Nov 10 14:52:49 user nova-compute[75703]:       </nova:ports>
Nov 10 14:52:49 user nova-compute[75703]:     </nova:instance>
Nov 10 14:52:49 user nova-compute[75703]:   </metadata>
Nov 10 14:52:49 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:52:49 user nova-compute[75703]:     <system>
Nov 10 14:52:49 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:52:49 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:52:49 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:52:49 user nova-compute[75703]:       <entry name="serial">471151e9-5ab6-483e-a2fa-a32743cf8667</entry>
Nov 10 14:52:49 user nova-compute[75703]:       <entry name="uuid">471151e9-5ab6-483e-a2fa-a32743cf8667</entry>
Nov 10 14:52:49 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:52:49 user nova-compute[75703]:     </system>
Nov 10 14:52:49 user nova-compute[75703]:   </sysinfo>
Nov 10 14:52:49 user nova-compute[75703]:   <os>
Nov 10 14:52:49 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:52:49 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:52:49 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:52:49 user nova-compute[75703]:   </os>
Nov 10 14:52:49 user nova-compute[75703]:   <features>
Nov 10 14:52:49 user nova-compute[75703]:     <acpi/>
Nov 10 14:52:49 user nova-compute[75703]:     <apic/>
Nov 10 14:52:49 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:52:49 user nova-compute[75703]:   </features>
Nov 10 14:52:49 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:52:49 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:52:49 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:52:49 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:52:49 user nova-compute[75703]:   </clock>
Nov 10 14:52:49 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:52:49 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:52:49 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:52:49 user nova-compute[75703]:   </cpu>
Nov 10 14:52:49 user nova-compute[75703]:   <devices>
Nov 10 14:52:49 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:52:49 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:52:49 user nova-compute[75703]:       <source dev="/dev/sdb"/>
Nov 10 14:52:49 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:52:49 user nova-compute[75703]:       <serial>faafe044-4e14-4046-aec4-01372c02ef0d</serial>
Nov 10 14:52:49 user nova-compute[75703]:     </disk>
Nov 10 14:52:49 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:52:49 user nova-compute[75703]:       <mac address="fa:16:3e:42:be:39"/>
Nov 10 14:52:49 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:49 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:52:49 user nova-compute[75703]:       <target dev="tap304ff27f-da"/>
Nov 10 14:52:49 user nova-compute[75703]:     </interface>
Nov 10 14:52:49 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:52:49 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667/console.log" append="off"/>
Nov 10 14:52:49 user nova-compute[75703]:     </serial>
Nov 10 14:52:49 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:52:49 user nova-compute[75703]:     <video>
Nov 10 14:52:49 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:52:49 user nova-compute[75703]:     </video>
Nov 10 14:52:49 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:52:49 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:52:49 user nova-compute[75703]:     </rng>
Nov 10 14:52:49 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:52:49 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:52:49 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:52:49 user nova-compute[75703]:     </memballoon>
Nov 10 14:52:49 user nova-compute[75703]:   </devices>
Nov 10 14:52:49 user nova-compute[75703]: </domain>
Nov 10 14:52:49 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T14:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312694834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1896305358',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItxue1DidduH42pp9kYmPEujA4hUUQ2wFm6mS1Wiwes11rnDY7FHYVd3vWDvUqZRoIqErX6oavuWfj1PjS9sBJ+dH68+CyzFblvDHNbUAJY9b0Z2ykurlZu+u/RterZLQ==',key_name='tempest-keypair-856963120',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d148c9594bb34eba9d4f17fd50b7d70b',ramdisk_id='',reservation_id='r-xkplm0ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1261295049',owner_user_name='tempest-ServerActionsV293TestJSON-1261295049-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:52:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='989965009f8847afae4743f6cb675a5b',uuid=471151e9-5ab6-483e-a2fa-a32743cf8667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converting VIF {"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG os_vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd6f6643-4b84-58b7-9a61-e64bb282658f', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap304ff27f-da, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap304ff27f-da, col_values=(('qos', UUID('f36faf49-c0d3-4e9b-ad88-313ab82ae88c')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap304ff27f-da, col_values=(('external_ids', {'iface-id': '304ff27f-da87-4fb5-96ec-5725ed77ead4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:be:39', 'vm-uuid': '471151e9-5ab6-483e-a2fa-a32743cf8667'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:50 user nova-compute[75703]: INFO os_vif [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da')
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] No VIF found with MAC fa:16:3e:42:be:39, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1dfcbf0-597e-4c60-9e4e-4c319d0b041e req-f6ef204b-c8db-4625-ac4c-8cdc228bcd71 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1dfcbf0-597e-4c60-9e4e-4c319d0b041e req-f6ef204b-c8db-4625-ac4c-8cdc228bcd71 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1dfcbf0-597e-4c60-9e4e-4c319d0b041e req-f6ef204b-c8db-4625-ac4c-8cdc228bcd71 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1dfcbf0-597e-4c60-9e4e-4c319d0b041e req-f6ef204b-c8db-4625-ac4c-8cdc228bcd71 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1dfcbf0-597e-4c60-9e4e-4c319d0b041e req-f6ef204b-c8db-4625-ac4c-8cdc228bcd71 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:50 user nova-compute[75703]: WARNING nova.compute.manager [req-a1dfcbf0-597e-4c60-9e4e-4c319d0b041e req-f6ef204b-c8db-4625-ac4c-8cdc228bcd71 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state building and task_state spawning.
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:52:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance spawned successfully.
Nov 10 14:52:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:51 user nova-compute[75703]: INFO nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Took 7.19 seconds to spawn the instance on the hypervisor.
Nov 10 14:52:51 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:52:51 user nova-compute[75703]: INFO nova.compute.manager [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Took 8.57 seconds to build instance.
Nov 10 14:52:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f980991-6dde-49ea-bec8-b751f9702b38 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.693s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:52 user nova-compute[75703]: WARNING nova.compute.manager [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 14:52:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:52:52 user nova-compute[75703]: WARNING nova.compute.manager [req-b5913492-fd2d-449e-8d20-b943ecb63a55 req-907760b0-63af-4590-866b-5550d1e75d2d service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:52:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance spawned successfully.
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG nova.objects.instance [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75703) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 14:52:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-336b5283-2bc4-4509-94c7-15defa2e0a38 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.113s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:52:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:57 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:52:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:52:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 14:52:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 14:52:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 1 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 14:52:58 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deletion of /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize failed
Nov 10 14:52:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:52:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:00 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:53:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:53:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:53:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:53:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:53:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=6965MB free_disk=24.994495391845703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0b071772-83ac-4848-b735-9dcfd41ee88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e01fd056-4ccd-4958-81a8-e7f3665feed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5224b8c5-414d-41d5-b973-71474c10a5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 14:53:08 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.421s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:11 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[34657790-5275-4b3b-bc4e-66e716bf6f31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:53:11 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddce8b15-2755-4425-ad4f-a04414dc293b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31] added
Nov 10 14:53:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8f2869-2479-4e49-bfc1-6818c099d8aa]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2507a9-3581-4a9e-a940-458c68f82281]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVjODHzc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVjODHzc" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd74e29-d8e8-49a7-9e12-81fe61d7076c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVjODHzc'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dc235d-ae48-4de4-b753-af2ebf287a59]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[613edfc5-3c6a-4b11-9346-c3926c6d82a9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[49351df2-60f3-4a16-a30b-8749fe14cfce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]
Nov 10 14:53:11 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.
Nov 10 14:53:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16bd1fd-8fab-40a5-a008-2007b6f0bda2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1724aa8-3164-42b8-9fe3-0f04fb4db11d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:11 user nova-compute[75703]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d3271-b534-4afb-8d46-1357991b6044]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:53:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:53:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23739316266646334', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739316266646334', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:53:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'flavor' on Instance uuid 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:53:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:53:12 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:12 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:53:12 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:53:12 user nova-compute[75703]:   <serial>ad7a55cb-38f3-4c16-b9af-25abfbcbbe31</serial>
Nov 10 14:53:12 user nova-compute[75703]: </disk>
Nov 10 14:53:12 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:53:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No VIF found with MAC fa:16:3e:4d:22:71, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:53:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-aa034b7a-4516-4cd9-965d-3f3de0dfc85a tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.465s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:14 user nova-compute[75703]: INFO nova.compute.manager [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Rebuilding instance
Nov 10 14:53:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-f76e1a7a-4dbb-4b76-bc2a-bd83f52837a5 req-f389eadc-07e4-49d8-88de-006f2adcb6cc service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f76e1a7a-4dbb-4b76-bc2a-bd83f52837a5 req-f389eadc-07e4-49d8-88de-006f2adcb6cc service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f76e1a7a-4dbb-4b76-bc2a-bd83f52837a5 req-f389eadc-07e4-49d8-88de-006f2adcb6cc service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f76e1a7a-4dbb-4b76-bc2a-bd83f52837a5 req-f389eadc-07e4-49d8-88de-006f2adcb6cc service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-f76e1a7a-4dbb-4b76-bc2a-bd83f52837a5 req-f389eadc-07e4-49d8-88de-006f2adcb6cc service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:14 user nova-compute[75703]: WARNING nova.compute.manager [req-f76e1a7a-4dbb-4b76-bc2a-bd83f52837a5 req-f389eadc-07e4-49d8-88de-006f2adcb6cc service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuilding.
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance destroyed successfully.
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: INFO nova.compute.manager [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Detaching volume ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: INFO nova.virt.block_device [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attempting to driver detach volume ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 from mountpoint /dev/vdb
Nov 10 14:53:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Attempting to detach device vdb from instance 0b071772-83ac-4848-b735-9dcfd41ee88a from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:53:15 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:15 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:53:15 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:53:15 user nova-compute[75703]:   <serial>ad7a55cb-38f3-4c16-b9af-25abfbcbbe31</serial>
Nov 10 14:53:15 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:53:15 user nova-compute[75703]: </disk>
Nov 10 14:53:15 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:53:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully detached device vdb from instance 0b071772-83ac-4848-b735-9dcfd41ee88a from the persistent domain config.
Nov 10 14:53:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:15 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[736fad08-f885-44c3-95ea-148c4b6c3347]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:53:15 user nova-compute[75703]: No targets found.
Nov 10 14:53:15 user nova-compute[75703]: iSNS:
Nov 10 14:53:15 user nova-compute[75703]: No targets found.
Nov 10 14:53:15 user nova-compute[75703]: STATIC:
Nov 10 14:53:15 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d
Nov 10 14:53:15 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:53:15 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:53:15 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:53:15 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:53:15 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:53:15 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:53:15 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:53:15 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:53:15 user nova-compute[75703]: FIRMWARE:
Nov 10 14:53:15 user nova-compute[75703]: No targets found.
Nov 10 14:53:15 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:53:15 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:53:15 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea16ac-7550-4829-997c-6eb4d5a1edd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e786f6-4c8e-453d-a440-24f80f3af58c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:15 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:15 user nova-compute[75703]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:15 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:15 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:15 user nova-compute[75703]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:15 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a47635b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5416d25a-3e4d-43c3-b321-3117896f2e01]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0526fcc7-2c4c-40d6-b59d-19b565b918db]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921c1d7-0c95-4e7a-a405-e23b4f7afc72]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cd1de6-d6f1-4af8-8f61-1532668c7880]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c6395-d903-4697-97b8-87246f1e555b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77baeac-48a5-45a3-8345-60d6194fcaff]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]
Nov 10 14:53:15 user nova-compute[75703]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.
Nov 10 14:53:15 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3d3a8-68ba-42b7-8b8d-7a580398ec07]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== disconnect_volume: return (349ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKkhjMmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:16 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[499ae8bc-ae9c-4321-a74a-787f11592d3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:53:16 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35d8f6-040c-4cec-adc8-63a3b1534822]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694] added
Nov 10 14:53:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48465d1-31a8-4709-beda-3ad0c045b72a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f7fa0a-b583-4236-8d25-49176fdcd640]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKkhjMmb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uKkhjMmb" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b81df4-19bf-4622-a344-649c852b3e8f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uKkhjMmb'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62ae281-b26a-4859-bd6f-238dff6c2b3b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7b5328-eeca-4c03-9e5a-dd0f0e71466b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e3ecc-2b32-47ff-bb71-3f09c6b887b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260]
Nov 10 14:53:16 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260] successful.
Nov 10 14:53:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80dadaf-172a-4ed8-87fe-20ec6f57db66]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e88747-3c24-4663-b684-77b888aec389]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:16 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:16 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3284dd65-9baf-410d-8bf7-bb6ac7775c73]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuilding.
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuilding.
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuilding.
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuilding.
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:16 user nova-compute[75703]: WARNING nova.compute.manager [req-a0a31726-39be-4968-8e4e-20070589d18e req-7e5c5dd0-fa38-4f74-ab2e-68cb98d53cca service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuilding.
Nov 10 14:53:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance destroyed successfully.
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993196221',display_name='tempest-ServerActionsTestOtherA-server-1577543893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993196221',id=19,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOXsfg8OtAF6y15f8pyf2zdKsfHHvx2Sl4DlV0LLsRlXzWk7nagjDQvEd+0CWh/8TFWwBen16W3DyFwmj7DfNKj73/gZHHXZoxnnPAJ3cPQ5Wjy8d1NpdmIwa4vcLAv4w==',key_name='tempest-keypair-2121173221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-m55zusr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=0b071772-83ac-4848-b735-9dcfd41ee88a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d2f146b-03, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ead47cce-3c03-4a0c-a0f9-c25771cb0c4f) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:17 user nova-compute[75703]: INFO os_vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03')
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:17 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKkhjMmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23961376535373535', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961376535373535', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.632s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.objects.instance [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'flavor' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c86819-d713-4e67-af38-c7bd8bb0a61b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:53:17 user nova-compute[75703]: No targets found.
Nov 10 14:53:17 user nova-compute[75703]: iSNS:
Nov 10 14:53:17 user nova-compute[75703]: No targets found.
Nov 10 14:53:17 user nova-compute[75703]: STATIC:
Nov 10 14:53:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694
Nov 10 14:53:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:53:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:53:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d
Nov 10 14:53:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:53:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:53:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:53:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:53:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:53:17 user nova-compute[75703]: FIRMWARE:
Nov 10 14:53:17 user nova-compute[75703]: No targets found.
Nov 10 14:53:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:53:17 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:53:17 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:53:17 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:17 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:53:17 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:53:17 user nova-compute[75703]:   <serial>ffc0405b-74f7-4932-b962-84cdd2249694</serial>
Nov 10 14:53:17 user nova-compute[75703]: </disk>
Nov 10 14:53:17 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc54b26e-4faa-4f03-85d4-a157eb5f8845]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0001cd-c976-4696-a49d-935485075a1f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:17 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:17 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:17 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:17 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a429cdc0>, {}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Disconnecting from: [] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== disconnect_volume: return (715ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:53:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Deleting instance files /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a_del
Nov 10 14:53:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Deletion of /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a_del complete
Nov 10 14:53:18 user nova-compute[75703]: INFO nova.virt.block_device [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Booting with volume ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 at /dev/vdb
Nov 10 14:53:18 user nova-compute[75703]: DEBUG os_brick.utils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de17536-aa52-4646-b089-5c2475ebcd06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0c67b-cb22-49c4-9b2b-c76b690fc801]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed7658f-fe1e-4064-8fc3-87a93a65ab65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d83b618-b00c-4d2b-b853-ef455f90c4d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:53:18 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a15e3f-8f40-444e-8abd-456945fdd280]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG os_brick.utils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating existing volume attachment record: cdb184d5-af0d-45e5-b28e-09e09b21d1a6 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No VIF found with MAC fa:16:3e:f7:a0:fa, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:53:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22845d9b-1a15-4bb6-855a-ae8778ea409d tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.279s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG nova.objects.instance [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'flavor' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:22 user nova-compute[75703]: INFO nova.compute.manager [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attaching volume 51d17896-c8f5-41f7-a358-65445e8b2c02 to /dev/vdc
Nov 10 14:53:22 user nova-compute[75703]: DEBUG os_brick.utils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9317072f-9bfe-4835-8def-ff5a7133cbbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2bdf79-2efc-4e48-84fb-6458243d63d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89583c-54b1-4006-9b2d-0b4596b05354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dbe01a-ac51-4037-ab6b-6c10f71b0efe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:53:22 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:53:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536a910-9d5d-48d0-aefd-6c0dfd5b770c]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG os_brick.utils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:22 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updating existing volume attachment record: 84a3ab65-2dc9-449c-a212-debb945510f5 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:53:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:53:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:53:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 14:53:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:53:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:53:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-changed-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Refreshing instance network info cache due to event network-changed-1c43802c-661b-4562-affe-83d945c2cddf. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:53:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] Acquiring lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:53:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] Acquired lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:53:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Refreshing network info cache for port 1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:53:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updated VIF entry in instance network info cache for port 1c43802c-661b-4562-affe-83d945c2cddf. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:53:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updating instance_info_cache with network_info: [{"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:53:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23e9fb21-3fe8-47c0-8009-152256662115 req-ce1a47ac-604d-4df8-ba62-4d14fffe347c service nova] Releasing lock "refresh_cache-5224b8c5-414d-41d5-b973-71474c10a5d0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:53:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:53:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Creating image(s)
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.169s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk 1073741824" returned: 0 in 0.049s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Cannot resize image /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Ensure instance console log exists: /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Start _get_guest_xml network_info=[{"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'cdb184d5-af0d-45e5-b28e-09e09b21d1a6', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0b071772-83ac-4848-b735-9dcfd41ee88a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'serial': 'ad7a55cb-38f3-4c16-b9af-25abfbcbbe31'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:53:44 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 14:53:44 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.objects.instance [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:44 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:53:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:44 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 14:53:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:44 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7a349-2e8b-4dd3-a299-5e7d3fb44ea1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:53:44 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e0cfe-26ae-4d21-948a-afadf9a7d304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31] added
Nov 10 14:53:45 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e895890-e209-46d6-a09f-c24ef7962912]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[74122e85-3f3a-4297-bbb6-eb072611ce7b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVjODHzc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVjODHzc" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc546c-70d6-4865-a428-7d52a8b7a7dd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVjODHzc'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[43193a96-d4ee-4f6e-85c9-d2d2603d9c8e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45f3335-aace-4256-aafe-50b270190040]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:45 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:45 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4646f699-a80c-47e0-a5a2-8f9cd7aba65a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]
Nov 10 14:53:45 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.
Nov 10 14:53:45 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae1b83e-f0b8-4a1e-b42e-f1aa1b01a7bb]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1defb19-d1d4-44a6-afa9-48ee4a2a0dc3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:45 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:45 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:45 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c8815-c54d-4bf8-a593-11fb309281cd]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:53:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23739316266646334', 'path': '/dev/sdd'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739316266646334', 'path': '/dev/sdd'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T14:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993196221',display_name='tempest-ServerActionsTestOtherA-server-1577543893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993196221',id=19,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOXsfg8OtAF6y15f8pyf2zdKsfHHvx2Sl4DlV0LLsRlXzWk7nagjDQvEd+0CWh/8TFWwBen16W3DyFwmj7DfNKj73/gZHHXZoxnnPAJ3cPQ5Wjy8d1NpdmIwa4vcLAv4w==',key_name='tempest-keypair-2121173221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-m55zusr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=0b071772-83ac-4848-b735-9dcfd41ee88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:53:46 user nova-compute[75703]:   <uuid>0b071772-83ac-4848-b735-9dcfd41ee88a</uuid>
Nov 10 14:53:46 user nova-compute[75703]:   <name>instance-00000013</name>
Nov 10 14:53:46 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:53:46 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:53:46 user nova-compute[75703]:   <metadata>
Nov 10 14:53:46 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:53:46 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:53:46 user nova-compute[75703]:       <nova:name>tempest-ServerActionsTestOtherA-server-1577543893</nova:name>
Nov 10 14:53:46 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:53:44</nova:creationTime>
Nov 10 14:53:46 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:53:46 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:53:46 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:53:46 user nova-compute[75703]:       <nova:owner>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:user uuid="23ee54b16d604b829f2088d8e850c48c">tempest-ServerActionsTestOtherA-1989770067-project-member</nova:user>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:project uuid="37ddb2fd8ebd40b0bee398bd9969a0ee">tempest-ServerActionsTestOtherA-1989770067</nova:project>
Nov 10 14:53:46 user nova-compute[75703]:       </nova:owner>
Nov 10 14:53:46 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:53:46 user nova-compute[75703]:       <nova:ports>
Nov 10 14:53:46 user nova-compute[75703]:         <nova:port uuid="3d2f146b-0393-4de8-9e6a-196f466b3872">
Nov 10 14:53:46 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 14:53:46 user nova-compute[75703]:         </nova:port>
Nov 10 14:53:46 user nova-compute[75703]:       </nova:ports>
Nov 10 14:53:46 user nova-compute[75703]:     </nova:instance>
Nov 10 14:53:46 user nova-compute[75703]:   </metadata>
Nov 10 14:53:46 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:53:46 user nova-compute[75703]:     <system>
Nov 10 14:53:46 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:53:46 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:53:46 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:53:46 user nova-compute[75703]:       <entry name="serial">0b071772-83ac-4848-b735-9dcfd41ee88a</entry>
Nov 10 14:53:46 user nova-compute[75703]:       <entry name="uuid">0b071772-83ac-4848-b735-9dcfd41ee88a</entry>
Nov 10 14:53:46 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:53:46 user nova-compute[75703]:     </system>
Nov 10 14:53:46 user nova-compute[75703]:   </sysinfo>
Nov 10 14:53:46 user nova-compute[75703]:   <os>
Nov 10 14:53:46 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:53:46 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:53:46 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:53:46 user nova-compute[75703]:   </os>
Nov 10 14:53:46 user nova-compute[75703]:   <features>
Nov 10 14:53:46 user nova-compute[75703]:     <acpi/>
Nov 10 14:53:46 user nova-compute[75703]:     <apic/>
Nov 10 14:53:46 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:53:46 user nova-compute[75703]:   </features>
Nov 10 14:53:46 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:53:46 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:53:46 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:53:46 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:53:46 user nova-compute[75703]:   </clock>
Nov 10 14:53:46 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:53:46 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:53:46 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:53:46 user nova-compute[75703]:   </cpu>
Nov 10 14:53:46 user nova-compute[75703]:   <devices>
Nov 10 14:53:46 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:53:46 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:53:46 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk"/>
Nov 10 14:53:46 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:53:46 user nova-compute[75703]:     </disk>
Nov 10 14:53:46 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:53:46 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:46 user nova-compute[75703]:       <source dev="/dev/sdd"/>
Nov 10 14:53:46 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:53:46 user nova-compute[75703]:       <serial>ad7a55cb-38f3-4c16-b9af-25abfbcbbe31</serial>
Nov 10 14:53:46 user nova-compute[75703]:     </disk>
Nov 10 14:53:46 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:53:46 user nova-compute[75703]:       <mac address="fa:16:3e:4d:22:71"/>
Nov 10 14:53:46 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:53:46 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:53:46 user nova-compute[75703]:       <target dev="tap3d2f146b-03"/>
Nov 10 14:53:46 user nova-compute[75703]:     </interface>
Nov 10 14:53:46 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:53:46 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/console.log" append="off"/>
Nov 10 14:53:46 user nova-compute[75703]:     </serial>
Nov 10 14:53:46 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:53:46 user nova-compute[75703]:     <video>
Nov 10 14:53:46 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:53:46 user nova-compute[75703]:     </video>
Nov 10 14:53:46 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:53:46 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:53:46 user nova-compute[75703]:     </rng>
Nov 10 14:53:46 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:53:46 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:53:46 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:53:46 user nova-compute[75703]:     </memballoon>
Nov 10 14:53:46 user nova-compute[75703]:   </devices>
Nov 10 14:53:46 user nova-compute[75703]: </domain>
Nov 10 14:53:46 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T14:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993196221',display_name='tempest-ServerActionsTestOtherA-server-1577543893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993196221',id=19,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOXsfg8OtAF6y15f8pyf2zdKsfHHvx2Sl4DlV0LLsRlXzWk7nagjDQvEd+0CWh/8TFWwBen16W3DyFwmj7DfNKj73/gZHHXZoxnnPAJ3cPQ5Wjy8d1NpdmIwa4vcLAv4w==',key_name='tempest-keypair-2121173221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-m55zusr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=0b071772-83ac-4848-b735-9dcfd41ee88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG os_vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a0653de-c9a5-58eb-9e06-26177b608d64', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d2f146b-03, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d2f146b-03, col_values=(('qos', UUID('2e9589ad-a8f4-483d-bb78-503b62c9bb9b')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d2f146b-03, col_values=(('external_ids', {'iface-id': '3d2f146b-0393-4de8-9e6a-196f466b3872', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:22:71', 'vm-uuid': '0b071772-83ac-4848-b735-9dcfd41ee88a'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:46 user nova-compute[75703]: INFO os_vif [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03')
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No VIF found with MAC fa:16:3e:4d:22:71, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-05eecb03-eba1-423c-9849-684e3d5a65c4 req-cc72ba4c-ccf1-4391-84a7-e06f68b7916d service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-05eecb03-eba1-423c-9849-684e3d5a65c4 req-cc72ba4c-ccf1-4391-84a7-e06f68b7916d service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-05eecb03-eba1-423c-9849-684e3d5a65c4 req-cc72ba4c-ccf1-4391-84a7-e06f68b7916d service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-05eecb03-eba1-423c-9849-684e3d5a65c4 req-cc72ba4c-ccf1-4391-84a7-e06f68b7916d service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-05eecb03-eba1-423c-9849-684e3d5a65c4 req-cc72ba4c-ccf1-4391-84a7-e06f68b7916d service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:47 user nova-compute[75703]: WARNING nova.compute.manager [req-05eecb03-eba1-423c-9849-684e3d5a65c4 req-cc72ba4c-ccf1-4391-84a7-e06f68b7916d service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 14:53:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:53:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance spawned successfully.
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-5c73b0ef-1371-415e-b0c4-8685a9e7c1b6 req-81b8f764-d9e4-4516-a8c2-c474a21fa1ba service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5c73b0ef-1371-415e-b0c4-8685a9e7c1b6 req-81b8f764-d9e4-4516-a8c2-c474a21fa1ba service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5c73b0ef-1371-415e-b0c4-8685a9e7c1b6 req-81b8f764-d9e4-4516-a8c2-c474a21fa1ba service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5c73b0ef-1371-415e-b0c4-8685a9e7c1b6 req-81b8f764-d9e4-4516-a8c2-c474a21fa1ba service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-5c73b0ef-1371-415e-b0c4-8685a9e7c1b6 req-81b8f764-d9e4-4516-a8c2-c474a21fa1ba service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:53:50 user nova-compute[75703]: WARNING nova.compute.manager [req-5c73b0ef-1371-415e-b0c4-8685a9e7c1b6 req-81b8f764-d9e4-4516-a8c2-c474a21fa1ba service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG nova.objects.instance [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75703) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 14:53:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3211b9f2-40e4-4466-b48a-64a2c3d7062e tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 5224b8c5-414d-41d5-b973-71474c10a5d0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPWcRvSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:53 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:53 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:53:53 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa676b2b-a3c1-4ee3-ab3a-650fcfcce612]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:53:53 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66087025-92fb-47b3-91f3-e8a2c4bdefae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02] added
Nov 10 14:53:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0fc60f-f7d9-45bd-b91f-28410781d622]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d43a55-0fd9-4f15-9db6-008b5ae4f052]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPWcRvSC {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPWcRvSC" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df435e-93e8-4567-9180-c41f4cee07ca]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPWcRvSC'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d39f79-3743-4b69-91f8-ac3a71ec0120]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c7d71-9dd1-4c7b-b11a-b5feae36f524]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:53 user nova-compute[75703]: INFO nova.compute.manager [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Attaching volume 2077939c-c89f-4397-afbf-7ab423a59ee9 to /dev/vdb
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1186a-3334-48c6-b24e-8dc9d845606f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260]
Nov 10 14:53:53 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260] successful.
Nov 10 14:53:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d8690e-f5ed-49b2-937f-e2e666f3ee32]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.utils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5922f3-d749-439d-b5b6-63e00f9f7e06]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)
Nov 10 14:53:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b699fc1-602c-4008-b5d2-48860ffcf1a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f3d65a-ed5c-4a97-9f5a-5db5fe4445c5]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPWcRvSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800c518-9046-49b7-9cb4-a2f6a07ef46e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e84352-ff14-4764-8397-693d729fcff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f091940-f9ee-43d7-8400-4e03b8a1d7c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:53:53 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:53:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8d4095-2bdb-45c2-b1d5-da95287e2a1e]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG os_brick.utils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:53 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updating existing volume attachment record: 50e47694-9858-40bc-af87-7bacd1df0bbd {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:53:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:53:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23531346337343061', 'path': '/dev/sde'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:53:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531346337343061', 'path': '/dev/sde'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:53:54 user nova-compute[75703]: DEBUG nova.objects.instance [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'flavor' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:53:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:53:54 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:54 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 14:53:54 user nova-compute[75703]:   <target dev="vdc" bus="virtio"/>
Nov 10 14:53:54 user nova-compute[75703]:   <serial>51d17896-c8f5-41f7-a358-65445e8b2c02</serial>
Nov 10 14:53:54 user nova-compute[75703]: </disk>
Nov 10 14:53:54 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:53:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:53:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] No VIF found with MAC fa:16:3e:f7:a0:fa, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:53:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c25114bf-2349-430f-8d91-353525052e23 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.286s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:53:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:53:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:53:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:53:57 user nova-compute[75703]: INFO nova.compute.manager [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Detaching volume 51d17896-c8f5-41f7-a358-65445e8b2c02
Nov 10 14:53:57 user nova-compute[75703]: INFO nova.virt.block_device [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attempting to driver detach volume 51d17896-c8f5-41f7-a358-65445e8b2c02 from mountpoint /dev/vdc
Nov 10 14:53:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Attempting to detach device vdc from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:53:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:53:57 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:57 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 14:53:57 user nova-compute[75703]:   <target dev="vdc" bus="virtio"/>
Nov 10 14:53:57 user nova-compute[75703]:   <serial>51d17896-c8f5-41f7-a358-65445e8b2c02</serial>
Nov 10 14:53:57 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 14:53:57 user nova-compute[75703]: </disk>
Nov 10 14:53:57 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:53:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Successfully detached device vdc from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the persistent domain config.
Nov 10 14:53:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:53:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:53:57 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:53:57 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 14:53:57 user nova-compute[75703]:   <target dev="vdc" bus="virtio"/>
Nov 10 14:53:57 user nova-compute[75703]:   <serial>51d17896-c8f5-41f7-a358-65445e8b2c02</serial>
Nov 10 14:53:57 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 14:53:57 user nova-compute[75703]: </disk>
Nov 10 14:53:57 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:53:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:53:58 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:53:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:54:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:54:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-changed-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Refreshing instance network info cache due to event network-changed-e251f077-3627-45d6-afb3-e1beec90ed70. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] Acquiring lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] Acquired lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Refreshing network info cache for port e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updated VIF entry in instance network info cache for port e251f077-3627-45d6-afb3-e1beec90ed70. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updating instance_info_cache with network_info: [{"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74118be9-6700-46ff-a836-aa8f09e6ff6d req-1549bdb5-f5bf-46e8-9dd7-1140c3989a2c service nova] Releasing lock "refresh_cache-2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:06 user nova-compute[75703]: INFO nova.compute.manager [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] instance snapshotting
Nov 10 14:54:06 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:54:06 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:54:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=6919MB free_disk=24.954509735107422GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Beginning live snapshot process
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0b071772-83ac-4848-b735-9dcfd41ee88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e01fd056-4ccd-4958-81a8-e7f3665feed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5224b8c5-414d-41d5-b973-71474c10a5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.924s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa4e96tmi/7b976dd4fd2f496d8f763336e6a598e0.delta 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa4e96tmi/7b976dd4fd2f496d8f763336e6a598e0.delta 1073741824" returned: 0 in 0.092s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:07 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 14:54:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Skipping network cache update for instance because it is being deleted. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:08 user nova-compute[75703]: INFO nova.compute.manager [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Terminating instance
Nov 10 14:54:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 14:54:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa4e96tmi/7b976dd4fd2f496d8f763336e6a598e0.delta /opt/stack/data/nova/instances/snapshots/tmpa4e96tmi/7b976dd4fd2f496d8f763336e6a598e0 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-22794dfd-201b-4225-bbc2-a0dcd0f83753 req-54141f0b-ca5a-44b0-81ee-d39dcc0cb476 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-unplugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-22794dfd-201b-4225-bbc2-a0dcd0f83753 req-54141f0b-ca5a-44b0-81ee-d39dcc0cb476 service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-22794dfd-201b-4225-bbc2-a0dcd0f83753 req-54141f0b-ca5a-44b0-81ee-d39dcc0cb476 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-22794dfd-201b-4225-bbc2-a0dcd0f83753 req-54141f0b-ca5a-44b0-81ee-d39dcc0cb476 service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-22794dfd-201b-4225-bbc2-a0dcd0f83753 req-54141f0b-ca5a-44b0-81ee-d39dcc0cb476 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-unplugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-22794dfd-201b-4225-bbc2-a0dcd0f83753 req-54141f0b-ca5a-44b0-81ee-d39dcc0cb476 service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-unplugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa4e96tmi/7b976dd4fd2f496d8f763336e6a598e0.delta /opt/stack/data/nova/instances/snapshots/tmpa4e96tmi/7b976dd4fd2f496d8f763336e6a598e0" returned: 0 in 0.293s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Snapshot extracted, beginning image upload
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Instance destroyed successfully.
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lazy-loading 'resources' on Instance uuid 471151e9-5ab6-483e-a2fa-a32743cf8667 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T14:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-312694834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1896305358',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItxue1DidduH42pp9kYmPEujA4hUUQ2wFm6mS1Wiwes11rnDY7FHYVd3vWDvUqZRoIqErX6oavuWfj1PjS9sBJ+dH68+CyzFblvDHNbUAJY9b0Z2ykurlZu+u/RterZLQ==',key_name='tempest-keypair-856963120',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d148c9594bb34eba9d4f17fd50b7d70b',ramdisk_id='',reservation_id='r-xkplm0ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1261295049',owner_user_name='tempest-ServerActionsV293TestJSON-1261295049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='989965009f8847afae4743f6cb675a5b',uuid=471151e9-5ab6-483e-a2fa-a32743cf8667,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converting VIF {"id": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "address": "fa:16:3e:42:be:39", "network": {"id": "f14e8e86-eed9-41e2-86eb-82f0d7e2b18c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-3527752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d148c9594bb34eba9d4f17fd50b7d70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304ff27f-da", "ovs_interfaceid": "304ff27f-da87-4fb5-96ec-5725ed77ead4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_vif [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap304ff27f-da, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f36faf49-c0d3-4e9b-ad88-313ab82ae88c) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:09 user nova-compute[75703]: INFO os_vif [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:be:39,bridge_name='br-int',has_traffic_filtering=True,id=304ff27f-da87-4fb5-96ec-5725ed77ead4,network=Network(f14e8e86-eed9-41e2-86eb-82f0d7e2b18c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304ff27f-da')
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHJBhkya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:54:09 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e7ad09-7526-4940-8781-885a2f6478a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:54:09 user nova-compute[75703]: No targets found.
Nov 10 14:54:09 user nova-compute[75703]: iSNS:
Nov 10 14:54:09 user nova-compute[75703]: No targets found.
Nov 10 14:54:09 user nova-compute[75703]: STATIC:
Nov 10 14:54:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694
Nov 10 14:54:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d
Nov 10 14:54:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:54:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:54:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02
Nov 10 14:54:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:09 user nova-compute[75703]: FIRMWARE:
Nov 10 14:54:09 user nova-compute[75703]: No targets found.
Nov 10 14:54:09 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:54:09 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:54:09 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0504486e-c610-485a-9b04-8675157fac3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62655b-59e2-4789-a4d2-1c185658b909]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)
Nov 10 14:54:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:10 user nova-compute[75703]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)
Nov 10 14:54:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a420c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beca93c-f922-4768-9cae-90e513cb83ad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4d9af-03e1-45ec-a8ec-fbfa7fc9799c]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a589a7-a467-41f9-9121-0916beed1061]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[47531777-a86a-47af-b2ad-2c350671bc49]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG nova.objects.instance [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lazy-loading 'flavor' on Instance uuid 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_69d7a183', '/dev/disk/by-id/scsi-1SCST_BIO69d7a183-9c8c143a66a89770', '/dev/disk/by-id/scsi-23963386331343361') {{(pid=87268) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e52bd7-a48a-4bb7-a54f-ac083e982309]: (4, None) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[653476d3-3f71-4983-b23a-011c883ef827]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[29630f8c-b44d-4e6e-ace3-81d1e2584f20]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260]
Nov 10 14:54:10 user nova-compute[75703]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d, portal: 172.16.0.220,3260] successful.
Nov 10 14:54:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faafe044-4e14-4046-aec4-01372c02ef0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbdfbad-cc76-4c1a-85bc-2d899b3951f2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] <== disconnect_volume: return (420ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:54:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Deleting instance files /opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667_del
Nov 10 14:54:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Deletion of /opt/stack/data/nova/instances/471151e9-5ab6-483e-a2fa-a32743cf8667_del complete
Nov 10 14:54:10 user nova-compute[75703]: INFO nova.compute.manager [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:10 user nova-compute[75703]: INFO nova.compute.manager [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Attaching volume 80317257-c82c-493c-b788-539dda1a1dcd to /dev/vdb
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.utils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[11861b49-c1ed-4e35-8557-98c068c2b8af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be2b7d-e139-4607-815f-c030ffec1c31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55a0c7-6919-4450-8e75-81765dfa9004]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad6db7-104f-401b-a0c0-fc3ea550691a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:54:10 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:54:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f27a27-6d26-45ac-97b1-47ddfdac2141]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG os_brick.utils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:54:10 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updating existing volume attachment record: 87e67f0f-a86a-41f5-ab96-7d8b483a017d {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:11 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Took 0.84 seconds to deallocate network for instance.
Nov 10 14:54:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-a7fa8935-ebcb-4bc9-81a9-d4e9fa20c114 req-56909a63-3e2b-4589-899e-19174a83df4a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-deleted-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:11 user nova-compute[75703]: INFO nova.compute.manager [req-a7fa8935-ebcb-4bc9-81a9-d4e9fa20c114 req-56909a63-3e2b-4589-899e-19174a83df4a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Neutron deleted interface 304ff27f-da87-4fb5-96ec-5725ed77ead4; detaching it from the instance and deleting it from the info cache
Nov 10 14:54:11 user nova-compute[75703]: DEBUG nova.network.neutron [req-a7fa8935-ebcb-4bc9-81a9-d4e9fa20c114 req-56909a63-3e2b-4589-899e-19174a83df4a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-a7fa8935-ebcb-4bc9-81a9-d4e9fa20c114 req-56909a63-3e2b-4589-899e-19174a83df4a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Detach interface failed, port_id=304ff27f-da87-4fb5-96ec-5725ed77ead4, reason: Instance 471151e9-5ab6-483e-a2fa-a32743cf8667 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-9855b2c4-771e-4df8-9d62-5362ac114d41 req-c19d0296-c6aa-46e4-aa61-6e309f28c11a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9855b2c4-771e-4df8-9d62-5362ac114d41 req-c19d0296-c6aa-46e4-aa61-6e309f28c11a service nova] Acquiring lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9855b2c4-771e-4df8-9d62-5362ac114d41 req-c19d0296-c6aa-46e4-aa61-6e309f28c11a service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9855b2c4-771e-4df8-9d62-5362ac114d41 req-c19d0296-c6aa-46e4-aa61-6e309f28c11a service nova] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-9855b2c4-771e-4df8-9d62-5362ac114d41 req-c19d0296-c6aa-46e4-aa61-6e309f28c11a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] No waiting events found dispatching network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:54:11 user nova-compute[75703]: WARNING nova.compute.manager [req-9855b2c4-771e-4df8-9d62-5362ac114d41 req-c19d0296-c6aa-46e4-aa61-6e309f28c11a service nova] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Received unexpected event network-vif-plugged-304ff27f-da87-4fb5-96ec-5725ed77ead4 for instance with vm_state active and task_state deleting.
Nov 10 14:54:12 user nova-compute[75703]: INFO nova.compute.manager [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Took 0.99 seconds to detach 1 volumes for instance.
Nov 10 14:54:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] [instance: 471151e9-5ab6-483e-a2fa-a32743cf8667] Deleting volume: faafe044-4e14-4046-aec4-01372c02ef0d {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 14:54:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Snapshot image upload complete
Nov 10 14:54:12 user nova-compute[75703]: INFO nova.compute.manager [None req-92fce740-5a6b-4996-9c54-f45029695488 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Took 5.65 seconds to snapshot the instance on the hypervisor.
Nov 10 14:54:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.volume.cinder [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Update attachment failed for attachment 50e47694-9858-40bc-af87-7bacd1df0bbd. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c919be4-d552-4004-ae60-d52de11dd0b6) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c919be4-d552-4004-ae60-d52de11dd0b6)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Failed to attach 2077939c-c89f-4397-afbf-7ab423a59ee9 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c919be4-d552-4004-ae60-d52de11dd0b6)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Traceback (most recent call last):
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     self._do_attach(context, instance, volume, volume_api,
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     self._volume_attach(context, volume, connector, instance,
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     connection_info = volume_api.attachment_update(
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     res = method(self, ctx, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     with excutils.save_and_reraise_exception():
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     self.force_reraise()
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     raise self.value
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     return method.func(obj, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     return self.request(url, method, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0]     raise exceptions.from_response(resp, body)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c919be4-d552-4004-ae60-d52de11dd0b6)
Nov 10 14:54:12 user nova-compute[75703]: ERROR nova.compute.manager [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] 
Nov 10 14:54:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.176s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server [None req-2978141b-86b7-45f0-b00b-e4c1c01b907f tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c919be4-d552-4004-ae60-d52de11dd0b6)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c919be4-d552-4004-ae60-d52de11dd0b6)
Nov 10 14:54:12 user nova-compute[75703]: ERROR oslo_messaging.rpc.server 
Nov 10 14:54:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:54:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:54:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.832s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:13 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Deleted allocations for instance 471151e9-5ab6-483e-a2fa-a32743cf8667
Nov 10 14:54:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a650d6d2-71d1-4e80-abac-7f9dbd3d7696 tempest-ServerActionsV293TestJSON-1261295049 tempest-ServerActionsV293TestJSON-1261295049-project-member] Lock "471151e9-5ab6-483e-a2fa-a32743cf8667" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.728s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:17 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 is timed out.
Nov 10 14:54:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Successfully detached device vdc from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the live domain config.
Nov 10 14:54:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPWcRvSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:54:17 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc69a4f-6284-46d1-8a27-909651ca5fce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:54:17 user nova-compute[75703]: No targets found.
Nov 10 14:54:17 user nova-compute[75703]: iSNS:
Nov 10 14:54:17 user nova-compute[75703]: No targets found.
Nov 10 14:54:17 user nova-compute[75703]: STATIC:
Nov 10 14:54:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694
Nov 10 14:54:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:54:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:54:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:17 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02
Nov 10 14:54:17 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:54:17 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:54:17 user nova-compute[75703]: FIRMWARE:
Nov 10 14:54:17 user nova-compute[75703]: No targets found.
Nov 10 14:54:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:54:17 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:54:17 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041fb8d-69f7-491d-b3c5-c7e5eb8f0088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa099c-cbe4-46e2-afd3-9912b6b2421d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:17 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:17 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:17 user nova-compute[75703]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)
Nov 10 14:54:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:17 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:17 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:17 user nova-compute[75703]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 (non-flash)
Nov 10 14:54:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a466eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02'): ({'sde'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Removing single pathed devices sde {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a12ab0-c92e-429e-b13d-a9c1d317114c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0e7ba-fc07-415f-a19b-937616398699]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Flushing IO for device /dev/sde {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577834e-5471-4315-a601-08a0b65e4b97]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf68ba5-cfed-4411-be14-27483a822b32]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[903d02cc-c42a-4759-86c7-45494bd7de86]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00ee724-c46e-4dd0-8a7b-de0139a0ce00]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260]
Nov 10 14:54:18 user nova-compute[75703]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02, portal: 172.16.0.220,3260] successful.
Nov 10 14:54:18 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d17896-c8f5-41f7-a358-65445e8b2c02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9cbaec-803d-442b-a54e-0b88ac5975a9]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] <== disconnect_volume: return (313ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:54:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:54:19 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'flavor' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6c4d1076-d8d4-41c7-9a03-f42f6e2e458b tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.040s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:54:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-changed-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Refreshing instance network info cache due to event network-changed-47551cdd-8e4e-4435-937a-697529c6f13b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:54:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] Acquiring lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:54:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] Acquired lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:54:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Refreshing network info cache for port 47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:54:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updated VIF entry in instance network info cache for port 47551cdd-8e4e-4435-937a-697529c6f13b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:54:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4a233e63-3496-4cb1-85f3-21800ec6ce2a req-7800008a-6342-45e7-a185-04c8ef9b0a1c service nova] Releasing lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "interface-408dc601-9a7e-4af4-ba22-48c3d54eb66f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "interface-408dc601-9a7e-4af4-ba22-48c3d54eb66f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'flavor' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'pci_requests' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG nova.objects.base [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Object Instance<408dc601-9a7e-4af4-ba22-48c3d54eb66f> lazy-loaded attributes: flavor,pci_requests {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG nova.policy [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b78d2e0b1bcb4f8f988203951bee984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53005799e814ffaa5cbf22041cfe1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:54:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Successfully created port: 3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Successfully updated port: 3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquired lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-changed-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Refreshing instance network info cache due to event network-changed-3c6cac92-d56d-4318-a315-97dcb51b6bc6. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:54:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] Acquiring lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.network.neutron [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Releasing lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] Acquired lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Refreshing network info cache for port 3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG os_vif [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94873e5e-0719-5f61-8178-aad6d1fa98b9', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c6cac92-d5, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c6cac92-d5, col_values=(('qos', UUID('6495282a-192a-44bd-90ed-3f14d37a2165')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c6cac92-d5, col_values=(('external_ids', {'iface-id': '3c6cac92-d56d-4318-a315-97dcb51b6bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:8d:10', 'vm-uuid': '408dc601-9a7e-4af4-ba22-48c3d54eb66f'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: INFO os_vif [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5')
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] attach device xml: <interface type="ethernet">
Nov 10 14:54:32 user nova-compute[75703]:   <mac address="fa:16:3e:b3:8d:10"/>
Nov 10 14:54:32 user nova-compute[75703]:   <model type="virtio"/>
Nov 10 14:54:32 user nova-compute[75703]:   <mtu size="1442"/>
Nov 10 14:54:32 user nova-compute[75703]:   <target dev="tap3c6cac92-d5"/>
Nov 10 14:54:32 user nova-compute[75703]: </interface>
Nov 10 14:54:32 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-6f82af98-b63a-4f2c-986e-92e0a07a4794 req-4b164c82-8d65-47ee-81be-b22dcd7f43d1 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6f82af98-b63a-4f2c-986e-92e0a07a4794 req-4b164c82-8d65-47ee-81be-b22dcd7f43d1 service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6f82af98-b63a-4f2c-986e-92e0a07a4794 req-4b164c82-8d65-47ee-81be-b22dcd7f43d1 service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6f82af98-b63a-4f2c-986e-92e0a07a4794 req-4b164c82-8d65-47ee-81be-b22dcd7f43d1 service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-6f82af98-b63a-4f2c-986e-92e0a07a4794 req-4b164c82-8d65-47ee-81be-b22dcd7f43d1 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:54:32 user nova-compute[75703]: WARNING nova.compute.manager [req-6f82af98-b63a-4f2c-986e-92e0a07a4794 req-4b164c82-8d65-47ee-81be-b22dcd7f43d1 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 for instance with vm_state active and task_state None.
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No BDM found with device name hda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No VIF found with MAC fa:16:3e:62:33:07, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:54:33 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:54:33 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:54:33 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:54:33</nova:creationTime>
Nov 10 14:54:33 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:54:33 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:54:33 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:54:33 user nova-compute[75703]:   <nova:owner>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:54:33 user nova-compute[75703]:   </nova:owner>
Nov 10 14:54:33 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:54:33 user nova-compute[75703]:   <nova:ports>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:54:33 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:54:33 user nova-compute[75703]:     </nova:port>
Nov 10 14:54:33 user nova-compute[75703]:     <nova:port uuid="3c6cac92-d56d-4318-a315-97dcb51b6bc6">
Nov 10 14:54:33 user nova-compute[75703]:       <nova:ip type="fixed" address="10.10.10.109" ipVersion="4"/>
Nov 10 14:54:33 user nova-compute[75703]:     </nova:port>
Nov 10 14:54:33 user nova-compute[75703]:   </nova:ports>
Nov 10 14:54:33 user nova-compute[75703]: </nova:instance>
Nov 10 14:54:33 user nova-compute[75703]:  {{(pid=75703) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d2bea181-2400-4691-98cf-18693384cee7 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "interface-408dc601-9a7e-4af4-ba22-48c3d54eb66f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.823s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updated VIF entry in instance network info cache for port 3c6cac92-d56d-4318-a315-97dcb51b6bc6. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.network.neutron [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2c3f0ff2-3bdd-401f-aab9-49fe4092b75a req-8406e47e-5143-4e1d-89c4-7db05f1f33ea service nova] Releasing lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'flavor' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:33 user nova-compute[75703]: INFO nova.compute.manager [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Attaching volume 9d29cae5-a20a-488e-97dc-a3111a18be8a to /dev/vdb
Nov 10 14:54:33 user nova-compute[75703]: DEBUG os_brick.utils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a5e48-b39c-419a-88a2-631cbd490052]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d953e2-875e-49e0-95f0-223fdc70bbf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc52000-79de-4eda-99dd-d56553d9d0b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3b805-d72c-42ea-a784-39a04f25da58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:54:33 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:54:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacb3c6-d309-46f0-8412-85eb8cebfcb1]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG os_brick.utils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:54:33 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating existing volume attachment record: 8c228bde-7e60-4bd3-8f56-435abed65d47 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:54:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-a08cd1cb-c6b1-4764-a823-004b1f163f9f req-3298f502-0a34-4eb9-a908-9d44db15e60f service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:54:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a08cd1cb-c6b1-4764-a823-004b1f163f9f req-3298f502-0a34-4eb9-a908-9d44db15e60f service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a08cd1cb-c6b1-4764-a823-004b1f163f9f req-3298f502-0a34-4eb9-a908-9d44db15e60f service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a08cd1cb-c6b1-4764-a823-004b1f163f9f req-3298f502-0a34-4eb9-a908-9d44db15e60f service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-a08cd1cb-c6b1-4764-a823-004b1f163f9f req-3298f502-0a34-4eb9-a908-9d44db15e60f service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:54:34 user nova-compute[75703]: WARNING nova.compute.manager [req-a08cd1cb-c6b1-4764-a823-004b1f163f9f req-3298f502-0a34-4eb9-a908-9d44db15e60f service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 for instance with vm_state active and task_state None.
Nov 10 14:54:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCzqyQlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:54:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:54:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:54:37 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180bdbf-1efb-42e3-a2ee-e84c4f83035e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:54:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76b235-6a09-49ed-bd0c-90b90fe3bf45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd] added
Nov 10 14:54:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b4996-e378-4938-beae-f57020a030c5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[11945ab7-6c87-4c2e-ac5b-d2816a3292b3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCzqyQlb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCzqyQlb" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850afaa-010c-49e8-b39a-a5f65bf1a7ef]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCzqyQlb'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a79b76-f079-4a13-bd65-384439ee3133]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b316450-750b-40d0-8ad7-9701435a4401]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae1ac2-f078-46d9-b2ec-5241bd057677]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260]
Nov 10 14:54:37 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260] successful.
Nov 10 14:54:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6cb6de-a42b-44f9-9a2e-bf73d4dfb254]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedeb1a3-1589-4dd1-8c05-0d3bf3d811ec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd (non-flash)
Nov 10 14:54:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:54:37 user nova-compute[75703]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd (non-flash)
Nov 10 14:54:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0752f5-914d-4d77-907c-37f25725fe1f]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:54:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCzqyQlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:54:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:54:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23339393233333734', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:54:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339393233333734', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:54:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lazy-loading 'flavor' on Instance uuid 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:54:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:54:38 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:54:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:54:38 user nova-compute[75703]:   <serial>80317257-c82c-493c-b788-539dda1a1dcd</serial>
Nov 10 14:54:38 user nova-compute[75703]: </disk>
Nov 10 14:54:38 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] No VIF found with MAC fa:16:3e:28:b1:29, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22519bc8-09ba-4e38-a168-e01e61d2e1a3 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.945s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'flavor' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:39 user nova-compute[75703]: INFO nova.compute.manager [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Attaching volume e2698b12-9352-4739-994b-05d4c4535ce9 to /dev/vdb
Nov 10 14:54:39 user nova-compute[75703]: DEBUG os_brick.utils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[518d29bc-ea06-49c1-895a-3814954be71c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed500d-01e8-4f41-9cc6-daee7d0fc1a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c793e3-1b49-40c0-89a3-ededb74cc43e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1f93b6-b139-4c5c-87c6-ce7af1c81862]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:54:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:54:40 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:54:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac30e929-c364-4717-b480-99328ca7db6a]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG os_brick.utils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating existing volume attachment record: b851a167-ff5c-4dfc-a999-aa3571fcfd4f {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:40 user nova-compute[75703]: INFO nova.compute.manager [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Detaching volume 80317257-c82c-493c-b788-539dda1a1dcd
Nov 10 14:54:40 user nova-compute[75703]: INFO nova.virt.block_device [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Attempting to driver detach volume 80317257-c82c-493c-b788-539dda1a1dcd from mountpoint /dev/vdb
Nov 10 14:54:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Attempting to detach device vdb from instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:54:40 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:54:40 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:54:40 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:54:40 user nova-compute[75703]:   <serial>80317257-c82c-493c-b788-539dda1a1dcd</serial>
Nov 10 14:54:40 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:54:40 user nova-compute[75703]: </disk>
Nov 10 14:54:40 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:54:40 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Successfully detached device vdb from instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 from the persistent domain config.
Nov 10 14:54:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:54:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:54:40 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:54:40 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:54:40 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:54:40 user nova-compute[75703]:   <serial>80317257-c82c-493c-b788-539dda1a1dcd</serial>
Nov 10 14:54:40 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:54:40 user nova-compute[75703]: </disk>
Nov 10 14:54:40 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:54:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:54:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:54:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:54:47 user nova-compute[75703]: INFO nova.compute.manager [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Detaching volume ffc0405b-74f7-4932-b962-84cdd2249694
Nov 10 14:54:47 user nova-compute[75703]: INFO nova.virt.block_device [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Attempting to driver detach volume ffc0405b-74f7-4932-b962-84cdd2249694 from mountpoint /dev/vdb
Nov 10 14:54:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Attempting to detach device vdb from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:54:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:54:47 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:54:47 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:54:47 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:54:47 user nova-compute[75703]:   <serial>ffc0405b-74f7-4932-b962-84cdd2249694</serial>
Nov 10 14:54:47 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:54:47 user nova-compute[75703]: </disk>
Nov 10 14:54:47 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:54:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Successfully detached device vdb from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the persistent domain config.
Nov 10 14:54:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:54:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:54:47 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:54:47 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:54:47 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:54:47 user nova-compute[75703]:   <serial>ffc0405b-74f7-4932-b962-84cdd2249694</serial>
Nov 10 14:54:47 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 14:54:47 user nova-compute[75703]: </disk>
Nov 10 14:54:47 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:54:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:54:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:54:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:54:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:55:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:00 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:55:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 is timed out.
Nov 10 14:55:01 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Successfully detached device vdb from instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 from the live domain config.
Nov 10 14:55:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCzqyQlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:01 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f406c95a-6664-45cb-b190-c475873be4bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:55:01 user nova-compute[75703]: No targets found.
Nov 10 14:55:01 user nova-compute[75703]: iSNS:
Nov 10 14:55:01 user nova-compute[75703]: No targets found.
Nov 10 14:55:01 user nova-compute[75703]: STATIC:
Nov 10 14:55:01 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694
Nov 10 14:55:01 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:01 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:01 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:55:01 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:01 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:01 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd
Nov 10 14:55:01 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:01 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:01 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:55:01 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:01 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:01 user nova-compute[75703]: FIRMWARE:
Nov 10 14:55:01 user nova-compute[75703]: No targets found.
Nov 10 14:55:01 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:55:01 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:55:01 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e6ef9-d588-4ee6-95b2-cc2fa35e42f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df16a4-640a-42c3-ade0-a0c1de687770]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:01 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:01 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:01 user nova-compute[75703]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd (non-flash)
Nov 10 14:55:01 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:01 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:01 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:01 user nova-compute[75703]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd (non-flash)
Nov 10 14:55:01 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43eb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ef4af6-be46-42ca-9483-865c8ecd772d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545adc0-1c30-4fe9-89ed-43a3921627fc]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0b40e9-29b8-40f7-a5fc-588dff9ee45a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf9264-2309-436c-b3c2-629c31d793b9]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[236873cd-b3ab-457b-97f3-ccebc6939d2c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e55272-1c91-4316-b3c5-7783f546e619]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260]
Nov 10 14:55:01 user nova-compute[75703]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd, portal: 172.16.0.220,3260] successful.
Nov 10 14:55:01 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80317257-c82c-493c-b788-539dda1a1dcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c21cb-9006-4983-9b30-a860bd6c527f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] <== disconnect_volume: return (399ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lazy-loading 'flavor' on Instance uuid 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f2cb58a1-ecfb-4d6f-bfa6-cccec5e56e05 tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.089s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:05 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:05 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:05 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:55:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e1da2b-88aa-4673-962b-71cbb641fbd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:55:06 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aebd1ee-d7c0-44eb-a880-0ea876c80de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9] added
Nov 10 14:55:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[df819753-fafe-47f6-9459-deade3beb02b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec66ac22-9030-44c1-a71a-222a629626e2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvEVLMhr {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvEVLMhr" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e434b-fbbb-41f4-abe0-8ae68dbafa38]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvEVLMhr'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.135s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec43f5-9a6a-462d-b8bd-08aba3071387]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[600194ba-062f-4be7-85c1-b2646ab8453d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db9d93-8759-4a2e-8da4-7ca6534279ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]
Nov 10 14:55:06 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.
Nov 10 14:55:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:06 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7274MB free_disk=24.864551544189453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce4d13c-822d-493e-84e0-417dc75f9156]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc05efcb-9b43-4afc-8cb5-e23b19c49c75]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:06 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.892s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee614e-a048-46d1-aed0-f13237ae21b1]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0b071772-83ac-4848-b735-9dcfd41ee88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e01fd056-4ccd-4958-81a8-e7f3665feed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5224b8c5-414d-41d5-b973-71474c10a5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.924s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== connect_volume: return (1928ms) {'type': 'block', 'scsi_wwn': '23535303632326334', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535303632326334', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'flavor' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:55:07 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:55:07 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:55:07 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:55:07 user nova-compute[75703]:   <serial>e2698b12-9352-4739-994b-05d4c4535ce9</serial>
Nov 10 14:55:07 user nova-compute[75703]: </disk>
Nov 10 14:55:07 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:55:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 is timed out.
Nov 10 14:55:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Successfully detached device vdb from instance e01fd056-4ccd-4958-81a8-e7f3665feed1 from the live domain config.
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uKkhjMmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:08 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922fd20-6ade-4e66-bae6-15f4a42dcb66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:55:08 user nova-compute[75703]: No targets found.
Nov 10 14:55:08 user nova-compute[75703]: iSNS:
Nov 10 14:55:08 user nova-compute[75703]: No targets found.
Nov 10 14:55:08 user nova-compute[75703]: STATIC:
Nov 10 14:55:08 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694
Nov 10 14:55:08 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:08 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:08 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9
Nov 10 14:55:08 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:08 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:08 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:55:08 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:08 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:08 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:55:08 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:08 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:08 user nova-compute[75703]: FIRMWARE:
Nov 10 14:55:08 user nova-compute[75703]: No targets found.
Nov 10 14:55:08 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:55:08 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:55:08 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c340e-4986-49d8-80ce-3c46b8e1cfbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No VIF found with MAC fa:16:3e:dc:3b:b9, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2be7ed-0cbf-4296-80b2-73ed92402f34]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:08 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:08 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:08 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:08 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:08 user nova-compute[75703]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 (non-flash)
Nov 10 14:55:08 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:08 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:08 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43f1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd5e56b-05a0-40e1-907e-29dcc0716dda]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e82ae6-50a8-48c3-8738-9fbf8f01769f]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf1952-c4c4-43d7-bb63-1abf2ea5449d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c22ac-1817-42e9-bc5b-3dbec3696714]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92d1907-520b-4cbb-90b6-da21ddad6017]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b3ca0f-32ce-481f-a82d-0d03673c9940]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260]
Nov 10 14:55:08 user nova-compute[75703]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694, portal: 172.16.0.220,3260] successful.
Nov 10 14:55:08 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffc0405b-74f7-4932-b962-84cdd2249694 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6cf8c-ff1d-4e2b-b7f6-2944faeff19c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] <== disconnect_volume: return (357ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8dd1644e-3a88-4eb9-b720-1b8c0c84b43d tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.855s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'flavor' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a76d1d92-1c6d-4184-aa0c-2633602c1d05 tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.173s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:55:12 user nova-compute[75703]: INFO nova.compute.claims [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Claim successful on node user
Nov 10 14:55:12 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:55:12 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:55:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.policy [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9806be7af5fd410d971f2384899eab85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ca92ae18d432da1805be8bcdb88dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:55:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Creating image(s)
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "/opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "/opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk 1073741824" returned: 0 in 0.047s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Successfully created port: eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:55:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Cannot resize image /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Ensure instance console log exists: /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Successfully updated port: eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "refresh_cache-1a4d9342-78d9-47df-b1c8-1fa64fcb13da" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquired lock "refresh_cache-1a4d9342-78d9-47df-b1c8-1fa64fcb13da" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-changed-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Refreshing instance network info cache due to event network-changed-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] Acquiring lock "refresh_cache-1a4d9342-78d9-47df-b1c8-1fa64fcb13da" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:55:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Updating instance_info_cache with network_info: [{"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Releasing lock "refresh_cache-1a4d9342-78d9-47df-b1c8-1fa64fcb13da" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Instance network_info: |[{"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] Acquired lock "refresh_cache-1a4d9342-78d9-47df-b1c8-1fa64fcb13da" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.neutron [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Refreshing network info cache for port eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Start _get_guest_xml network_info=[{"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:55:15 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:15 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1842189213',display_name='tempest-ServersNegativeTestJSON-server-1842189213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1842189213',id=27,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ca92ae18d432da1805be8bcdb88dd',ramdisk_id='',reservation_id='r-n0kwl7ut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2142185333',owner_user_name='tempest-ServersNegativeTestJSON-2142185333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:55:13Z,user_data=None,user_id='9806be7af5fd410d971f2384899eab85',uuid=1a4d9342-78d9-47df-b1c8-1fa64fcb13da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converting VIF {"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a4d9342-78d9-47df-b1c8-1fa64fcb13da {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:55:15 user nova-compute[75703]:   <uuid>1a4d9342-78d9-47df-b1c8-1fa64fcb13da</uuid>
Nov 10 14:55:15 user nova-compute[75703]:   <name>instance-0000001b</name>
Nov 10 14:55:15 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:55:15 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:55:15 user nova-compute[75703]:   <metadata>
Nov 10 14:55:15 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:55:15 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:55:15 user nova-compute[75703]:       <nova:name>tempest-ServersNegativeTestJSON-server-1842189213</nova:name>
Nov 10 14:55:15 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:55:15</nova:creationTime>
Nov 10 14:55:15 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:55:15 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:55:15 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:55:15 user nova-compute[75703]:       <nova:owner>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:user uuid="9806be7af5fd410d971f2384899eab85">tempest-ServersNegativeTestJSON-2142185333-project-member</nova:user>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:project uuid="482ca92ae18d432da1805be8bcdb88dd">tempest-ServersNegativeTestJSON-2142185333</nova:project>
Nov 10 14:55:15 user nova-compute[75703]:       </nova:owner>
Nov 10 14:55:15 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:55:15 user nova-compute[75703]:       <nova:ports>
Nov 10 14:55:15 user nova-compute[75703]:         <nova:port uuid="eedef7f0-a5fc-48f9-9481-cd8b7e15ee34">
Nov 10 14:55:15 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 14:55:15 user nova-compute[75703]:         </nova:port>
Nov 10 14:55:15 user nova-compute[75703]:       </nova:ports>
Nov 10 14:55:15 user nova-compute[75703]:     </nova:instance>
Nov 10 14:55:15 user nova-compute[75703]:   </metadata>
Nov 10 14:55:15 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:55:15 user nova-compute[75703]:     <system>
Nov 10 14:55:15 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:55:15 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:55:15 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:55:15 user nova-compute[75703]:       <entry name="serial">1a4d9342-78d9-47df-b1c8-1fa64fcb13da</entry>
Nov 10 14:55:15 user nova-compute[75703]:       <entry name="uuid">1a4d9342-78d9-47df-b1c8-1fa64fcb13da</entry>
Nov 10 14:55:15 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:55:15 user nova-compute[75703]:     </system>
Nov 10 14:55:15 user nova-compute[75703]:   </sysinfo>
Nov 10 14:55:15 user nova-compute[75703]:   <os>
Nov 10 14:55:15 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:55:15 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:55:15 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:55:15 user nova-compute[75703]:   </os>
Nov 10 14:55:15 user nova-compute[75703]:   <features>
Nov 10 14:55:15 user nova-compute[75703]:     <acpi/>
Nov 10 14:55:15 user nova-compute[75703]:     <apic/>
Nov 10 14:55:15 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:55:15 user nova-compute[75703]:   </features>
Nov 10 14:55:15 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:55:15 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:55:15 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:55:15 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:55:15 user nova-compute[75703]:   </clock>
Nov 10 14:55:15 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:55:15 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:55:15 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:55:15 user nova-compute[75703]:   </cpu>
Nov 10 14:55:15 user nova-compute[75703]:   <devices>
Nov 10 14:55:15 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:55:15 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:55:15 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk"/>
Nov 10 14:55:15 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:55:15 user nova-compute[75703]:     </disk>
Nov 10 14:55:15 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:55:15 user nova-compute[75703]:       <mac address="fa:16:3e:b3:67:dd"/>
Nov 10 14:55:15 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:55:15 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:55:15 user nova-compute[75703]:       <target dev="tapeedef7f0-a5"/>
Nov 10 14:55:15 user nova-compute[75703]:     </interface>
Nov 10 14:55:15 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:55:15 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/console.log" append="off"/>
Nov 10 14:55:15 user nova-compute[75703]:     </serial>
Nov 10 14:55:15 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:55:15 user nova-compute[75703]:     <video>
Nov 10 14:55:15 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:55:15 user nova-compute[75703]:     </video>
Nov 10 14:55:15 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:55:15 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:55:15 user nova-compute[75703]:     </rng>
Nov 10 14:55:15 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:55:15 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:55:15 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:55:15 user nova-compute[75703]:     </memballoon>
Nov 10 14:55:15 user nova-compute[75703]:   </devices>
Nov 10 14:55:15 user nova-compute[75703]: </domain>
Nov 10 14:55:15 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1842189213',display_name='tempest-ServersNegativeTestJSON-server-1842189213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1842189213',id=27,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ca92ae18d432da1805be8bcdb88dd',ramdisk_id='',reservation_id='r-n0kwl7ut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2142185333',owner_user_name='tempest-ServersNegativeTestJSON-2142185333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:55:13Z,user_data=None,user_id='9806be7af5fd410d971f2384899eab85',uuid=1a4d9342-78d9-47df-b1c8-1fa64fcb13da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converting VIF {"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG os_vif [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e4a2b0c-6ed1-5603-9c30-50231065e73f', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeedef7f0-a5, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeedef7f0-a5, col_values=(('qos', UUID('ed7825c0-fc2f-4b75-94d8-63e329fae65d')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeedef7f0-a5, col_values=(('external_ids', {'iface-id': 'eedef7f0-a5fc-48f9-9481-cd8b7e15ee34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:67:dd', 'vm-uuid': '1a4d9342-78d9-47df-b1c8-1fa64fcb13da'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:15 user nova-compute[75703]: INFO os_vif [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5')
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] No VIF found with MAC fa:16:3e:b3:67:dd, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.neutron [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Updated VIF entry in instance network info cache for port eedef7f0-a5fc-48f9-9481-cd8b7e15ee34. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG nova.network.neutron [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Updating instance_info_cache with network_info: [{"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-92ecff43-3bae-41bf-96c9-c806a31bb885 req-2ed7c8d1-89d1-40cc-819d-955c0ced3c12 service nova] Releasing lock "refresh_cache-1a4d9342-78d9-47df-b1c8-1fa64fcb13da" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-75be2840-6c8d-4d62-84dd-121640e0f659 req-ff785b1b-19ca-4589-b05a-c91ae1bd5fc3 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-75be2840-6c8d-4d62-84dd-121640e0f659 req-ff785b1b-19ca-4589-b05a-c91ae1bd5fc3 service nova] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-75be2840-6c8d-4d62-84dd-121640e0f659 req-ff785b1b-19ca-4589-b05a-c91ae1bd5fc3 service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-75be2840-6c8d-4d62-84dd-121640e0f659 req-ff785b1b-19ca-4589-b05a-c91ae1bd5fc3 service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-75be2840-6c8d-4d62-84dd-121640e0f659 req-ff785b1b-19ca-4589-b05a-c91ae1bd5fc3 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] No waiting events found dispatching network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:16 user nova-compute[75703]: WARNING nova.compute.manager [req-75be2840-6c8d-4d62-84dd-121640e0f659 req-ff785b1b-19ca-4589-b05a-c91ae1bd5fc3 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received unexpected event network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 for instance with vm_state building and task_state spawning.
Nov 10 14:55:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:55:18 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Instance spawned successfully.
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:55:18 user nova-compute[75703]: INFO nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 10 14:55:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:55:18 user nova-compute[75703]: INFO nova.compute.manager [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Took 6.40 seconds to build instance.
Nov 10 14:55:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8761bb36-3859-4867-bc2a-e783d1d64d15 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.493s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-afbb6c00-e39a-4cdc-b0ba-8d3b81125705 req-b61a7e15-f169-4b00-b222-8953a7f2b44f service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-afbb6c00-e39a-4cdc-b0ba-8d3b81125705 req-b61a7e15-f169-4b00-b222-8953a7f2b44f service nova] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-afbb6c00-e39a-4cdc-b0ba-8d3b81125705 req-b61a7e15-f169-4b00-b222-8953a7f2b44f service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-afbb6c00-e39a-4cdc-b0ba-8d3b81125705 req-b61a7e15-f169-4b00-b222-8953a7f2b44f service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-afbb6c00-e39a-4cdc-b0ba-8d3b81125705 req-b61a7e15-f169-4b00-b222-8953a7f2b44f service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] No waiting events found dispatching network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:19 user nova-compute[75703]: WARNING nova.compute.manager [req-afbb6c00-e39a-4cdc-b0ba-8d3b81125705 req-b61a7e15-f169-4b00-b222-8953a7f2b44f service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received unexpected event network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 for instance with vm_state active and task_state None.
Nov 10 14:55:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:55:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:22 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:55:22 user nova-compute[75703]: INFO nova.compute.claims [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Claim successful on node user
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:55:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:55:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:55:23 user nova-compute[75703]: INFO nova.virt.block_device [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Booting with volume snapshot e7707e29-21f6-49d8-aa82-99e6c78e1f39 at /dev/vda
Nov 10 14:55:23 user nova-compute[75703]: DEBUG nova.policy [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67a5a4845f164d8cba0951d82f2430e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c013cf84f8b414ba6d2d888ddc2ee1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Successfully created port: 0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-changed-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing instance network info cache due to event network-changed-66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:24 user nova-compute[75703]: DEBUG nova.network.neutron [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updated VIF entry in instance network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-69ad3b2d-420d-48e0-9a4c-2574b0be88cb req-34a88458-ac62-4388-a472-ee4aa33bdba0 service nova] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Successfully updated port: 0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "refresh_cache-adf2c465-ae08-4bc1-a3f4-ef2b6f830552" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquired lock "refresh_cache-adf2c465-ae08-4bc1-a3f4-ef2b6f830552" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Updating instance_info_cache with network_info: [{"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Releasing lock "refresh_cache-adf2c465-ae08-4bc1-a3f4-ef2b6f830552" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Instance network_info: |[{"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:55:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-changed-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Refreshing instance network info cache due to event network-changed-0eac2a8e-edca-4788-848e-d50b69876ffc. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:55:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] Acquiring lock "refresh_cache-adf2c465-ae08-4bc1-a3f4-ef2b6f830552" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] Acquired lock "refresh_cache-adf2c465-ae08-4bc1-a3f4-ef2b6f830552" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Refreshing network info cache for port 0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-changed-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing instance network info cache due to event network-changed-66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Updated VIF entry in instance network info cache for port 0eac2a8e-edca-4788-848e-d50b69876ffc. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Updating instance_info_cache with network_info: [{"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8f2f5826-55ca-4457-bd7e-dea4a6e45100 req-ae7c1f9d-eb5b-4e61-af9d-b8474c98bd6a service nova] Releasing lock "refresh_cache-adf2c465-ae08-4bc1-a3f4-ef2b6f830552" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updated VIF entry in instance network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-823a56e3-a94a-42b6-a8a7-5586ee4c19d9 req-bbc6d447-07bf-4ffd-8658-33057acc0271 service nova] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:27 user nova-compute[75703]: INFO nova.compute.manager [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Rescuing
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG nova.compute.manager [req-1e63560b-92ad-4246-958c-4219c196bc66 req-8e973cf7-a739-4004-8bab-d4d6d046fc5b service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1e63560b-92ad-4246-958c-4219c196bc66 req-8e973cf7-a739-4004-8bab-d4d6d046fc5b service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1e63560b-92ad-4246-958c-4219c196bc66 req-8e973cf7-a739-4004-8bab-d4d6d046fc5b service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1e63560b-92ad-4246-958c-4219c196bc66 req-8e973cf7-a739-4004-8bab-d4d6d046fc5b service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG nova.compute.manager [req-1e63560b-92ad-4246-958c-4219c196bc66 req-8e973cf7-a739-4004-8bab-d4d6d046fc5b service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:28 user nova-compute[75703]: WARNING nova.compute.manager [req-1e63560b-92ad-4246-958c-4219c196bc66 req-8e973cf7-a739-4004-8bab-d4d6d046fc5b service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state active and task_state rescuing.
Nov 10 14:55:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance destroyed successfully.
Nov 10 14:55:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Attempting rescue
Nov 10 14:55:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75703) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 14:55:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Creating image(s)
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue" returned: 0 in 0.063s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'migration_context' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.base [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<a7660cf1-f3ab-4ce6-990f-676f84317fd6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Start _get_guest_xml network_info=[{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:e0:e4:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'resources' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.base [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<a7660cf1-f3ab-4ce6-990f-676f84317fd6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'numa_topology' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.base [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<a7660cf1-f3ab-4ce6-990f-676f84317fd6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.base [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<a7660cf1-f3ab-4ce6-990f-676f84317fd6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179544045',display_name='tempest-ServerRescueNegativeTestJSON-server-1179544045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179544045',id=17,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-qo37v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:50:39Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=a7660cf1-f3ab-4ce6-990f-676f84317fd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:e0:e4:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:e0:e4:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'pci_devices' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.objects.base [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<a7660cf1-f3ab-4ce6-990f-676f84317fd6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:55:29 user nova-compute[75703]:   <uuid>a7660cf1-f3ab-4ce6-990f-676f84317fd6</uuid>
Nov 10 14:55:29 user nova-compute[75703]:   <name>instance-00000011</name>
Nov 10 14:55:29 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:55:29 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:55:29 user nova-compute[75703]:   <metadata>
Nov 10 14:55:29 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:55:29 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:55:29 user nova-compute[75703]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1179544045</nova:name>
Nov 10 14:55:29 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:55:29</nova:creationTime>
Nov 10 14:55:29 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:55:29 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:55:29 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:55:29 user nova-compute[75703]:       <nova:owner>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:user uuid="6b7b8488f5964719b7b47ac4416c59ea">tempest-ServerRescueNegativeTestJSON-1926780524-project-member</nova:user>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:project uuid="5703fd918f4547218ac7ef97d6b1bbdc">tempest-ServerRescueNegativeTestJSON-1926780524</nova:project>
Nov 10 14:55:29 user nova-compute[75703]:       </nova:owner>
Nov 10 14:55:29 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:55:29 user nova-compute[75703]:       <nova:ports>
Nov 10 14:55:29 user nova-compute[75703]:         <nova:port uuid="887034ca-08fe-490d-9562-7ab8c57a8f21">
Nov 10 14:55:29 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 14:55:29 user nova-compute[75703]:         </nova:port>
Nov 10 14:55:29 user nova-compute[75703]:       </nova:ports>
Nov 10 14:55:29 user nova-compute[75703]:     </nova:instance>
Nov 10 14:55:29 user nova-compute[75703]:   </metadata>
Nov 10 14:55:29 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:55:29 user nova-compute[75703]:     <system>
Nov 10 14:55:29 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:55:29 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:55:29 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:55:29 user nova-compute[75703]:       <entry name="serial">a7660cf1-f3ab-4ce6-990f-676f84317fd6</entry>
Nov 10 14:55:29 user nova-compute[75703]:       <entry name="uuid">a7660cf1-f3ab-4ce6-990f-676f84317fd6</entry>
Nov 10 14:55:29 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:55:29 user nova-compute[75703]:     </system>
Nov 10 14:55:29 user nova-compute[75703]:   </sysinfo>
Nov 10 14:55:29 user nova-compute[75703]:   <os>
Nov 10 14:55:29 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:55:29 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:55:29 user nova-compute[75703]:   </os>
Nov 10 14:55:29 user nova-compute[75703]:   <features>
Nov 10 14:55:29 user nova-compute[75703]:     <acpi/>
Nov 10 14:55:29 user nova-compute[75703]:     <apic/>
Nov 10 14:55:29 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:55:29 user nova-compute[75703]:   </features>
Nov 10 14:55:29 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:55:29 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:55:29 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:55:29 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:55:29 user nova-compute[75703]:   </clock>
Nov 10 14:55:29 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:55:29 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:55:29 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:55:29 user nova-compute[75703]:   </cpu>
Nov 10 14:55:29 user nova-compute[75703]:   <devices>
Nov 10 14:55:29 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:55:29 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:55:29 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue"/>
Nov 10 14:55:29 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:55:29 user nova-compute[75703]:     </disk>
Nov 10 14:55:29 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:55:29 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:55:29 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk"/>
Nov 10 14:55:29 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:55:29 user nova-compute[75703]:     </disk>
Nov 10 14:55:29 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:55:29 user nova-compute[75703]:       <mac address="fa:16:3e:e0:e4:6b"/>
Nov 10 14:55:29 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:55:29 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:55:29 user nova-compute[75703]:       <target dev="tap887034ca-08"/>
Nov 10 14:55:29 user nova-compute[75703]:     </interface>
Nov 10 14:55:29 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:55:29 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/console.log" append="off"/>
Nov 10 14:55:29 user nova-compute[75703]:     </serial>
Nov 10 14:55:29 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:55:29 user nova-compute[75703]:     <video>
Nov 10 14:55:29 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:55:29 user nova-compute[75703]:     </video>
Nov 10 14:55:29 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:55:29 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:55:29 user nova-compute[75703]:     </rng>
Nov 10 14:55:29 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:55:29 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:55:29 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:55:29 user nova-compute[75703]:     </memballoon>
Nov 10 14:55:29 user nova-compute[75703]:   </devices>
Nov 10 14:55:29 user nova-compute[75703]: </domain>
Nov 10 14:55:29 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:55:29 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance destroyed successfully.
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:e0:e4:6b, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:55:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-7316493c-a209-4dd8-acf2-11fb5e847331 req-9fce0b60-3121-40d9-adef-d9d94072d752 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7316493c-a209-4dd8-acf2-11fb5e847331 req-9fce0b60-3121-40d9-adef-d9d94072d752 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7316493c-a209-4dd8-acf2-11fb5e847331 req-9fce0b60-3121-40d9-adef-d9d94072d752 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7316493c-a209-4dd8-acf2-11fb5e847331 req-9fce0b60-3121-40d9-adef-d9d94072d752 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-7316493c-a209-4dd8-acf2-11fb5e847331 req-9fce0b60-3121-40d9-adef-d9d94072d752 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:30 user nova-compute[75703]: WARNING nova.compute.manager [req-7316493c-a209-4dd8-acf2-11fb5e847331 req-9fce0b60-3121-40d9-adef-d9d94072d752 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state active and task_state rescuing.
Nov 10 14:55:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:32 user nova-compute[75703]: WARNING nova.compute.manager [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state active and task_state rescuing.
Nov 10 14:55:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:32 user nova-compute[75703]: WARNING nova.compute.manager [req-bdf02efb-dca0-4b12-88dc-b78ccb189a55 req-6c77995c-9fe3-46d4-af2a-3b5ab545899d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state active and task_state rescuing.
Nov 10 14:55:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a3d9d708-691c-443f-8da2-2aaca50e8c7e tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:55:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQHyhUkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:36 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:36 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:36 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[068d22f0-0e7a-4140-9f27-c449b03d0201]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:55:36 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d256b-6ee8-4e3d-a8b4-71ef80367463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a] added
Nov 10 14:55:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a5d446-a1a6-4d86-a85f-3e42f004e4ae]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0429b029-4bc6-40a2-85c5-758552a5d70d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQHyhUkn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQHyhUkn" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f0ace-c9ae-443a-8c84-6e194b7a70a8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PQHyhUkn'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[693f0515-773c-4ca3-9a0d-0f7da976f064]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d12f7-1fe1-480e-82ca-f58d07008a33]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9bc00-dabf-4a0d-8a14-07d6c1392bbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260]
Nov 10 14:55:36 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260] successful.
Nov 10 14:55:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f853a-7b8c-4c96-b438-e55f7ce160df]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7380e3-9572-4283-8622-a529007cbbd9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:36 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d37736-c91b-41d8-b269-6c87d6dba1e1]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:55:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQHyhUkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:55:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23538386162353965', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538386162353965', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:55:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'flavor' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 14:55:37 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:55:37 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:55:37 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:55:37 user nova-compute[75703]:   <serial>9d29cae5-a20a-488e-97dc-a3111a18be8a</serial>
Nov 10 14:55:37 user nova-compute[75703]: </disk>
Nov 10 14:55:37 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No BDM found with device name hda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] No VIF found with MAC fa:16:3e:62:33:07, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:38 user nova-compute[75703]: INFO nova.compute.manager [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Terminating instance
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-87c1e777-61b6-449c-b308-34de15e3dd23 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.649s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-f6212026-a61e-4824-900e-c45afdaab0ce req-e51c1950-44ec-4131-a58f-6d69a5fe8f82 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-vif-unplugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f6212026-a61e-4824-900e-c45afdaab0ce req-e51c1950-44ec-4131-a58f-6d69a5fe8f82 service nova] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f6212026-a61e-4824-900e-c45afdaab0ce req-e51c1950-44ec-4131-a58f-6d69a5fe8f82 service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f6212026-a61e-4824-900e-c45afdaab0ce req-e51c1950-44ec-4131-a58f-6d69a5fe8f82 service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-f6212026-a61e-4824-900e-c45afdaab0ce req-e51c1950-44ec-4131-a58f-6d69a5fe8f82 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] No waiting events found dispatching network-vif-unplugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-f6212026-a61e-4824-900e-c45afdaab0ce req-e51c1950-44ec-4131-a58f-6d69a5fe8f82 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-vif-unplugged-839dd737-26d3-4eea-9600-63d40f2e6181 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Instance destroyed successfully.
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lazy-loading 'resources' on Instance uuid e01fd056-4ccd-4958-81a8-e7f3665feed1 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-810835417',display_name='tempest-TestServerVolumeAttachmentScenario-server-810835417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-810835417',id=20,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN9G0BFa2/wJI9y3fdq4+4V3mIrKzCRIk2QdKrxxdpoPgILDUxwv0/V1bsLhFYzgGX2rYy0TA6pl4iq7wIAY9KrjOAbkYj13C1kjk5M4NSRdmWOW/DuhK7LUW8eZ+2ksw==',key_name='tempest-keypair-1410498672',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1449926681744a1996072effc9947b88',ramdisk_id='',reservation_id='r-u5pbvdb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1430018624',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1430018624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75341ec55afc47b89b4a56e33c0bf9e2',uuid=e01fd056-4ccd-4958-81a8-e7f3665feed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Converting VIF {"id": "839dd737-26d3-4eea-9600-63d40f2e6181", "address": "fa:16:3e:f7:a0:fa", "network": {"id": "d421216c-0a65-4d57-bd03-d53cf6586601", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1822032266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1449926681744a1996072effc9947b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839dd737-26", "ovs_interfaceid": "839dd737-26d3-4eea-9600-63d40f2e6181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG os_vif [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839dd737-26, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bd796e5-0a98-4118-9bed-6d583f634836) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: INFO os_vif [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a0:fa,bridge_name='br-int',has_traffic_filtering=True,id=839dd737-26d3-4eea-9600-63d40f2e6181,network=Network(d421216c-0a65-4d57-bd03-d53cf6586601),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839dd737-26')
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Deleting instance files /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1_del
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Deletion of /opt/stack/data/nova/instances/e01fd056-4ccd-4958-81a8-e7f3665feed1_del complete
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.compute.manager [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 10 14:55:39 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.compute.manager [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Detaching volume 9d29cae5-a20a-488e-97dc-a3111a18be8a
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.virt.block_device [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Attempting to driver detach volume 9d29cae5-a20a-488e-97dc-a3111a18be8a from mountpoint /dev/vdb
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Attempting to detach device vdb from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:55:39 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:55:39 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:55:39 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:55:39 user nova-compute[75703]:   <serial>9d29cae5-a20a-488e-97dc-a3111a18be8a</serial>
Nov 10 14:55:39 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 14:55:39 user nova-compute[75703]: </disk>
Nov 10 14:55:39 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:55:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully detached device vdb from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the persistent domain config.
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:55:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:55:39 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:55:39 user nova-compute[75703]:   <source dev="/dev/sdc"/>
Nov 10 14:55:39 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:55:39 user nova-compute[75703]:   <serial>9d29cae5-a20a-488e-97dc-a3111a18be8a</serial>
Nov 10 14:55:39 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 14:55:39 user nova-compute[75703]: </disk>
Nov 10 14:55:39 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:40 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Took 0.84 seconds to deallocate network for instance.
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] Acquiring lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] No waiting events found dispatching network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:40 user nova-compute[75703]: WARNING nova.compute.manager [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received unexpected event network-vif-plugged-839dd737-26d3-4eea-9600-63d40f2e6181 for instance with vm_state deleted and task_state None.
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-48b5b135-22e3-4aa1-a769-d87b426b42af req-65117273-609c-44c5-91cf-b759d85bab65 service nova] [instance: e01fd056-4ccd-4958-81a8-e7f3665feed1] Received event network-vif-deleted-839dd737-26d3-4eea-9600-63d40f2e6181 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:40 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Deleted allocations for instance e01fd056-4ccd-4958-81a8-e7f3665feed1
Nov 10 14:55:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988497cf-8b24-4bd5-b09a-2c9ab7f70e3a tempest-TestServerVolumeAttachmentScenario-1430018624 tempest-TestServerVolumeAttachmentScenario-1430018624-project-member] Lock "e01fd056-4ccd-4958-81a8-e7f3665feed1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:43 user nova-compute[75703]: INFO nova.compute.manager [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Terminating instance
Nov 10 14:55:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-d523ca19-8611-4b2d-ac58-f934fac7f2a4 req-6038b8f1-5236-41ba-a841-b0a66abbd174 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-vif-unplugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d523ca19-8611-4b2d-ac58-f934fac7f2a4 req-6038b8f1-5236-41ba-a841-b0a66abbd174 service nova] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d523ca19-8611-4b2d-ac58-f934fac7f2a4 req-6038b8f1-5236-41ba-a841-b0a66abbd174 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d523ca19-8611-4b2d-ac58-f934fac7f2a4 req-6038b8f1-5236-41ba-a841-b0a66abbd174 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-d523ca19-8611-4b2d-ac58-f934fac7f2a4 req-6038b8f1-5236-41ba-a841-b0a66abbd174 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] No waiting events found dispatching network-vif-unplugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-d523ca19-8611-4b2d-ac58-f934fac7f2a4 req-6038b8f1-5236-41ba-a841-b0a66abbd174 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-vif-unplugged-e251f077-3627-45d6-afb3-e1beec90ed70 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_brick.utils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550a944-4479-4002-ab32-ddeeed0d5ba3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5199f817-1023-497f-9cf0-9c10d871cd94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff713bac-e1c6-40a5-a565-8de033a12e7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[722d0d68-daf6-463b-aa77-39d7efed2cf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:55:44 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc14dd2-8133-43e3-bd1e-fdd0f79b7ac4]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_brick.utils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Updating existing volume attachment record: 5357d23d-1bd3-430b-a3ff-630611846237 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:55:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Instance destroyed successfully.
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.objects.instance [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lazy-loading 'resources' on Instance uuid 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-529816427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5298164',id=23,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnhcoQ/f34xJHopZSOLKLl3H/DSvTkEIui0rfmQv/8qfu7qUJKG8acw7Jb0jgKUpYB74DAyt3ZcYFzNi8s5VMrF2fD3cPoJP3E62kQka4UrPomnaDjHlmyPbe7JdT2IgQ==',key_name='tempest-keypair-1913484416',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9334d547ca014a1fa5c01aaf5df27226',ramdisk_id='',reservation_id='r-69xp9pnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-162006392',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e246d79b094a4616bf66dde4c76efde1',uuid=2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Converting VIF {"id": "e251f077-3627-45d6-afb3-e1beec90ed70", "address": "fa:16:3e:28:b1:29", "network": {"id": "69a7967d-216b-4345-bd9f-bd7a7948f88e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113250225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9334d547ca014a1fa5c01aaf5df27226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape251f077-36", "ovs_interfaceid": "e251f077-3627-45d6-afb3-e1beec90ed70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG os_vif [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape251f077-36, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f27c1552-738d-4006-a829-61f40f5f7e22) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:55:44 user nova-compute[75703]: INFO os_vif [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:b1:29,bridge_name='br-int',has_traffic_filtering=True,id=e251f077-3627-45d6-afb3-e1beec90ed70,network=Network(69a7967d-216b-4345-bd9f-bd7a7948f88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape251f077-36')
Nov 10 14:55:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Deleting instance files /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5_del
Nov 10 14:55:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Deletion of /opt/stack/data/nova/instances/2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5_del complete
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:44 user nova-compute[75703]: INFO nova.compute.manager [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Rebooting instance
Nov 10 14:55:44 user nova-compute[75703]: INFO nova.compute.manager [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 14:55:44 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:55:44 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:55:45 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Took 0.84 seconds to deallocate network for instance.
Nov 10 14:55:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] Acquiring lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] No waiting events found dispatching network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:46 user nova-compute[75703]: WARNING nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received unexpected event network-vif-plugged-e251f077-3627-45d6-afb3-e1beec90ed70 for instance with vm_state deleted and task_state None.
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5] Received event network-vif-deleted-e251f077-3627-45d6-afb3-e1beec90ed70 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-unplugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-unplugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:46 user nova-compute[75703]: WARNING nova.compute.manager [req-d01b3427-812e-4703-a44e-1c456458ac98 req-47f3ddda-3324-43c3-9e63-34a19555a433 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-unplugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 14:55:46 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Deleted allocations for instance 2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ebc9ab56-2845-4539-a5e7-654989dcf70b tempest-TestServerVolumeAttachScenarioOldVersion-162006392 tempest-TestServerVolumeAttachScenarioOldVersion-162006392-project-member] Lock "2988f4a9-8d60-4c7f-bcf2-ca0e0bd051d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.613s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:46 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance destroyed successfully.
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'resources' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754884787',display_name='tempest-TestMinimumBasicScenario-server-754884787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754884787',id=26,image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCoLe9RFklcjNxsU1qMot0dyDlwkLe2Rugi+GRQW5T7to0FacTYosg0vCSAi82F3yNDq7XI/pSwICc5y/1Kcb/cUnCv8wt8ymoD7EvlN2E6eKZfhsv20mvUzLAjHdI01Q==',key_name='tempest-TestMinimumBasicScenario-543665677',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-d90rcwao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:55:46Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=0870c08a-f3dc-4299-aa98-b509d3cea1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66335289-42, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b4dd7aa-4c8e-4497-a08b-e42f2d988eb7) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:46 user nova-compute[75703]: INFO os_vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42')
Nov 10 14:55:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:46 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc98b0bb-9f8f-495c-92d7-9c445d235576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:55:46 user nova-compute[75703]: No targets found.
Nov 10 14:55:46 user nova-compute[75703]: iSNS:
Nov 10 14:55:46 user nova-compute[75703]: No targets found.
Nov 10 14:55:46 user nova-compute[75703]: STATIC:
Nov 10 14:55:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9
Nov 10 14:55:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:55:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:55:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a
Nov 10 14:55:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:55:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:55:46 user nova-compute[75703]: FIRMWARE:
Nov 10 14:55:46 user nova-compute[75703]: No targets found.
Nov 10 14:55:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:55:46 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:55:46 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef3bf04-8181-4915-bd32-e16b520366b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4a3df5-ace6-4b58-99ce-b08a513293fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:46 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:46 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:46 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:46 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:46 user nova-compute[75703]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:46 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43ccf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:55:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[56af4a61-d1ae-41b6-b287-1288b8a627d2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cae939-a44d-4944-9db7-0374515ad8cf]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db8c14-66ba-45ff-86c4-4afa5e2be6a7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4091357-f1f1-4865-8ada-14b643cfff28]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0fa16b-f487-4884-b1f7-b8786f6c1ae8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9262757d-67c1-4f7d-9338-295d13d32f11]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]
Nov 10 14:55:47 user nova-compute[75703]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab991e3-4977-490a-8fc0-1c4f830f7356]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== disconnect_volume: return (337ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Start _get_guest_xml network_info=[{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f634226-1552-4731-bfa4-dbb7e36bc0be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '5f634226-1552-4731-bfa4-dbb7e36bc0be'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'b851a167-ff5c-4dfc-a999-aa3571fcfd4f', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0870c08a-f3dc-4299-aa98-b509d3cea1e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2698b12-9352-4739-994b-05d4c4535ce9', 'serial': 'e2698b12-9352-4739-994b-05d4c4535ce9'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:55:47 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:47 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f634226-1552-4731-bfa4-dbb7e36bc0be,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.objects.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Object Instance<0870c08a-f3dc-4299-aa98-b509d3cea1e8> lazy-loaded attributes: resources,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:55:47 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:47 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:55:47 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf705b0b-ee09-449b-aec1-a87e8ac47d28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:55:47 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bdf044-1f9c-475b-a908-62c3f39e514d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9] added
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[83384ab1-3f1f-4c3f-800f-ae2ee9d7ee3e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbfdd5-8e77-4332-8de8-dab794249d4d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvEVLMhr {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvEVLMhr" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beb664e-dda2-47ed-b447-51de3bc6e468]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvEVLMhr'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[30850998-53e7-4e88-9b34-623fdfedfb5b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ea0b9-97dd-48bc-a539-9ff08ce72bf6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec3b0a-13da-4322-8eec-64fcd3db8190]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]
Nov 10 14:55:47 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd3b56-40db-4189-86db-aed4657bbac5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e3fc91-55ce-40f6-a0c9-ff2147d22631]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:55:47 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:55:47 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9055c303-8407-4f56-bde0-5a39e87fbe71]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:55:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-feb184f8-4937-423b-b5a1-d1e9cc67f42e req-517cd9f8-46d9-45d0-ad82-401bbe82f9de service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feb184f8-4937-423b-b5a1-d1e9cc67f42e req-517cd9f8-46d9-45d0-ad82-401bbe82f9de service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feb184f8-4937-423b-b5a1-d1e9cc67f42e req-517cd9f8-46d9-45d0-ad82-401bbe82f9de service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feb184f8-4937-423b-b5a1-d1e9cc67f42e req-517cd9f8-46d9-45d0-ad82-401bbe82f9de service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-feb184f8-4937-423b-b5a1-d1e9cc67f42e req-517cd9f8-46d9-45d0-ad82-401bbe82f9de service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:48 user nova-compute[75703]: WARNING nova.compute.manager [req-feb184f8-4937-423b-b5a1-d1e9cc67f42e req-517cd9f8-46d9-45d0-ad82-401bbe82f9de service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 14:55:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23535303632326334', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535303632326334', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754884787',display_name='tempest-TestMinimumBasicScenario-server-754884787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754884787',id=26,image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCoLe9RFklcjNxsU1qMot0dyDlwkLe2Rugi+GRQW5T7to0FacTYosg0vCSAi82F3yNDq7XI/pSwICc5y/1Kcb/cUnCv8wt8ymoD7EvlN2E6eKZfhsv20mvUzLAjHdI01Q==',key_name='tempest-TestMinimumBasicScenario-543665677',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-d90rcwao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:55:46Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=0870c08a-f3dc-4299-aa98-b509d3cea1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'pci_devices' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.objects.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Object Instance<0870c08a-f3dc-4299-aa98-b509d3cea1e8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:55:48 user nova-compute[75703]:   <uuid>0870c08a-f3dc-4299-aa98-b509d3cea1e8</uuid>
Nov 10 14:55:48 user nova-compute[75703]:   <name>instance-0000001a</name>
Nov 10 14:55:48 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:55:48 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:55:48 user nova-compute[75703]:   <metadata>
Nov 10 14:55:48 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:55:48 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:55:48 user nova-compute[75703]:       <nova:name>tempest-TestMinimumBasicScenario-server-754884787</nova:name>
Nov 10 14:55:48 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:55:47</nova:creationTime>
Nov 10 14:55:48 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:55:48 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:55:48 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:55:48 user nova-compute[75703]:       <nova:owner>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:user uuid="bbf6ec70894948e4886371fc014fc732">tempest-TestMinimumBasicScenario-700348367-project-member</nova:user>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:project uuid="6b22eaeb977349819aabde01a3b34930">tempest-TestMinimumBasicScenario-700348367</nova:project>
Nov 10 14:55:48 user nova-compute[75703]:       </nova:owner>
Nov 10 14:55:48 user nova-compute[75703]:       <nova:root type="image" uuid="5f634226-1552-4731-bfa4-dbb7e36bc0be"/>
Nov 10 14:55:48 user nova-compute[75703]:       <nova:ports>
Nov 10 14:55:48 user nova-compute[75703]:         <nova:port uuid="66335289-4294-4845-9d74-0111f74eb8f2">
Nov 10 14:55:48 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:55:48 user nova-compute[75703]:         </nova:port>
Nov 10 14:55:48 user nova-compute[75703]:       </nova:ports>
Nov 10 14:55:48 user nova-compute[75703]:     </nova:instance>
Nov 10 14:55:48 user nova-compute[75703]:   </metadata>
Nov 10 14:55:48 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:55:48 user nova-compute[75703]:     <system>
Nov 10 14:55:48 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:55:48 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:55:48 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:55:48 user nova-compute[75703]:       <entry name="serial">0870c08a-f3dc-4299-aa98-b509d3cea1e8</entry>
Nov 10 14:55:48 user nova-compute[75703]:       <entry name="uuid">0870c08a-f3dc-4299-aa98-b509d3cea1e8</entry>
Nov 10 14:55:48 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:55:48 user nova-compute[75703]:     </system>
Nov 10 14:55:48 user nova-compute[75703]:   </sysinfo>
Nov 10 14:55:48 user nova-compute[75703]:   <os>
Nov 10 14:55:48 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:55:48 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:55:48 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:55:48 user nova-compute[75703]:   </os>
Nov 10 14:55:48 user nova-compute[75703]:   <features>
Nov 10 14:55:48 user nova-compute[75703]:     <acpi/>
Nov 10 14:55:48 user nova-compute[75703]:     <apic/>
Nov 10 14:55:48 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:55:48 user nova-compute[75703]:   </features>
Nov 10 14:55:48 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:55:48 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:55:48 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:55:48 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:55:48 user nova-compute[75703]:   </clock>
Nov 10 14:55:48 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:55:48 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:55:48 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:55:48 user nova-compute[75703]:   </cpu>
Nov 10 14:55:48 user nova-compute[75703]:   <devices>
Nov 10 14:55:48 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:55:48 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:55:48 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk"/>
Nov 10 14:55:48 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:55:48 user nova-compute[75703]:     </disk>
Nov 10 14:55:48 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:55:48 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:55:48 user nova-compute[75703]:       <source dev="/dev/sdb"/>
Nov 10 14:55:48 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:55:48 user nova-compute[75703]:       <serial>e2698b12-9352-4739-994b-05d4c4535ce9</serial>
Nov 10 14:55:48 user nova-compute[75703]:     </disk>
Nov 10 14:55:48 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:55:48 user nova-compute[75703]:       <mac address="fa:16:3e:dc:3b:b9"/>
Nov 10 14:55:48 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:55:48 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:55:48 user nova-compute[75703]:       <target dev="tap66335289-42"/>
Nov 10 14:55:48 user nova-compute[75703]:     </interface>
Nov 10 14:55:48 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:55:48 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/console.log" append="off"/>
Nov 10 14:55:48 user nova-compute[75703]:     </serial>
Nov 10 14:55:48 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:55:48 user nova-compute[75703]:     <video>
Nov 10 14:55:48 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:55:48 user nova-compute[75703]:     </video>
Nov 10 14:55:48 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:55:48 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:55:48 user nova-compute[75703]:     </rng>
Nov 10 14:55:48 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:55:48 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:55:48 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:55:48 user nova-compute[75703]:     </memballoon>
Nov 10 14:55:48 user nova-compute[75703]:   </devices>
Nov 10 14:55:48 user nova-compute[75703]: </domain>
Nov 10 14:55:48 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.objects.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Object Instance<0870c08a-f3dc-4299-aa98-b509d3cea1e8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889 --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Cannot resize image /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'migration_context' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.objects.base [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Object Instance<0870c08a-f3dc-4299-aa98-b509d3cea1e8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754884787',display_name='tempest-TestMinimumBasicScenario-server-754884787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754884787',id=26,image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCoLe9RFklcjNxsU1qMot0dyDlwkLe2Rugi+GRQW5T7to0FacTYosg0vCSAi82F3yNDq7XI/pSwICc5y/1Kcb/cUnCv8wt8ymoD7EvlN2E6eKZfhsv20mvUzLAjHdI01Q==',key_name='tempest-TestMinimumBasicScenario-543665677',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-d90rcwao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:55:46Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=0870c08a-f3dc-4299-aa98-b509d3cea1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG os_vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62fab850-475e-5eb4-85ca-83855b487cb4', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66335289-42, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66335289-42, col_values=(('qos', UUID('d609d543-2483-4cd8-a1ab-8e8955afde76')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66335289-42, col_values=(('external_ids', {'iface-id': '66335289-4294-4845-9d74-0111f74eb8f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:3b:b9', 'vm-uuid': '0870c08a-f3dc-4299-aa98-b509d3cea1e8'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:55:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:49 user nova-compute[75703]: INFO os_vif [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42')
Nov 10 14:55:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-0c55d7f0-0b2e-4712-a94f-6486d62d2a3e req-59d83774-1e80-4905-9e01-d6930e9eaf66 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0c55d7f0-0b2e-4712-a94f-6486d62d2a3e req-59d83774-1e80-4905-9e01-d6930e9eaf66 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0c55d7f0-0b2e-4712-a94f-6486d62d2a3e req-59d83774-1e80-4905-9e01-d6930e9eaf66 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0c55d7f0-0b2e-4712-a94f-6486d62d2a3e req-59d83774-1e80-4905-9e01-d6930e9eaf66 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-0c55d7f0-0b2e-4712-a94f-6486d62d2a3e req-59d83774-1e80-4905-9e01-d6930e9eaf66 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:51 user nova-compute[75703]: WARNING nova.compute.manager [req-0c55d7f0-0b2e-4712-a94f-6486d62d2a3e req-59d83774-1e80-4905-9e01-d6930e9eaf66 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 14:55:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-b23353b6-7f40-46bf-ab46-67f63ea3bc07 req-fb8d7ed6-0bff-4c59-b7b9-db8fc9142f36 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:55:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b23353b6-7f40-46bf-ab46-67f63ea3bc07 req-fb8d7ed6-0bff-4c59-b7b9-db8fc9142f36 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:55:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b23353b6-7f40-46bf-ab46-67f63ea3bc07 req-fb8d7ed6-0bff-4c59-b7b9-db8fc9142f36 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:55:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b23353b6-7f40-46bf-ab46-67f63ea3bc07 req-fb8d7ed6-0bff-4c59-b7b9-db8fc9142f36 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-b23353b6-7f40-46bf-ab46-67f63ea3bc07 req-fb8d7ed6-0bff-4c59-b7b9-db8fc9142f36 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:55:53 user nova-compute[75703]: WARNING nova.compute.manager [req-b23353b6-7f40-46bf-ab46-67f63ea3bc07 req-fb8d7ed6-0bff-4c59-b7b9-db8fc9142f36 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 14:55:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:55:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance rebooted successfully.
Nov 10 14:55:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:55:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f45725f0-7b5b-423b-a15e-d369cf29dd40 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.421s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:55:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:55:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:55:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:56:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f is timed out.
Nov 10 14:56:00 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully detached device vdb from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the live domain config.
Nov 10 14:56:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQHyhUkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:56:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3e34aa-dd24-4942-926c-64316b241563]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:56:00 user nova-compute[75703]: No targets found.
Nov 10 14:56:00 user nova-compute[75703]: iSNS:
Nov 10 14:56:00 user nova-compute[75703]: No targets found.
Nov 10 14:56:00 user nova-compute[75703]: STATIC:
Nov 10 14:56:00 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9
Nov 10 14:56:00 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:00 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:00 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:56:00 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:00 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:00 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:56:00 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:00 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:00 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a
Nov 10 14:56:00 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:00 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:00 user nova-compute[75703]: FIRMWARE:
Nov 10 14:56:00 user nova-compute[75703]: No targets found.
Nov 10 14:56:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:56:00 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:56:00 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd8e866-7234-460a-8e98-8ea655c8056b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[da57df44-6037-4868-b089-3feabeed7cd0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:00 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:00 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:56:00 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:00 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:00 user nova-compute[75703]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a (non-flash)
Nov 10 14:56:00 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a41cf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c337449-7f8d-4ac1-b87d-e0f2d2e4c050]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c5772-0dd2-4d35-baab-4b0786d5a23f]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b6eb4-3338-4655-b1ba-b0ba2dec438e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19389ab9-dc6c-493b-bd23-4f204f0cd527]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[25317900-0986-4d7d-8955-04299d9eb1a2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ad10e3-2038-47ad-b021-37536c7efd71]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260]
Nov 10 14:56:00 user nova-compute[75703]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a, portal: 172.16.0.220,3260] successful.
Nov 10 14:56:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d29cae5-a20a-488e-97dc-a3111a18be8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f5c20-211c-43cf-88a2-e0b8fe4a0d0d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] <== disconnect_volume: return (323ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:56:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:56:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'flavor' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-3645eb22-bdf0-4134-b8c3-c4fba48bcb11 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.122s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "interface-408dc601-9a7e-4af4-ba22-48c3d54eb66f-3c6cac92-d56d-4318-a315-97dcb51b6bc6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "interface-408dc601-9a7e-4af4-ba22-48c3d54eb66f-3c6cac92-d56d-4318-a315-97dcb51b6bc6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'flavor' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface> {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface> {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Attempting to detach device tap3c6cac92-d5 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] detach device xml: <interface type="ethernet">
Nov 10 14:56:02 user nova-compute[75703]:   <mac address="fa:16:3e:b3:8d:10"/>
Nov 10 14:56:02 user nova-compute[75703]:   <model type="virtio"/>
Nov 10 14:56:02 user nova-compute[75703]:   <mtu size="1442"/>
Nov 10 14:56:02 user nova-compute[75703]:   <target dev="tap3c6cac92-d5"/>
Nov 10 14:56:02 user nova-compute[75703]: </interface>
Nov 10 14:56:02 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface> {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 10 14:56:02 user nova-compute[75703]:   <name>instance-00000019</name>
Nov 10 14:56:02 user nova-compute[75703]:   <uuid>408dc601-9a7e-4af4-ba22-48c3d54eb66f</uuid>
Nov 10 14:56:02 user nova-compute[75703]:   <metadata>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:02 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:56:02 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:56:02 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:54:33</nova:creationTime>
Nov 10 14:56:02 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:56:02 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:02 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:56:02 user nova-compute[75703]:   <nova:owner>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:56:02 user nova-compute[75703]:   </nova:owner>
Nov 10 14:56:02 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:02 user nova-compute[75703]:   <nova:ports>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:56:02 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:56:02 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:02 user nova-compute[75703]:     <nova:port uuid="3c6cac92-d56d-4318-a315-97dcb51b6bc6">
Nov 10 14:56:02 user nova-compute[75703]:       <nova:ip type="fixed" address="10.10.10.109" ipVersion="4"/>
Nov 10 14:56:02 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:02 user nova-compute[75703]:   </nova:ports>
Nov 10 14:56:02 user nova-compute[75703]: </nova:instance>
Nov 10 14:56:02 user nova-compute[75703]:   </metadata>
Nov 10 14:56:02 user nova-compute[75703]:   <memory unit='KiB'>524288</memory>
Nov 10 14:56:02 user nova-compute[75703]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 14:56:02 user nova-compute[75703]:   <vcpu placement='static'>1</vcpu>
Nov 10 14:56:02 user nova-compute[75703]:   <resource>
Nov 10 14:56:02 user nova-compute[75703]:     <partition>/machine</partition>
Nov 10 14:56:02 user nova-compute[75703]:   </resource>
Nov 10 14:56:02 user nova-compute[75703]:   <sysinfo type='smbios'>
Nov 10 14:56:02 user nova-compute[75703]:     <system>
Nov 10 14:56:02 user nova-compute[75703]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 14:56:02 user nova-compute[75703]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 14:56:02 user nova-compute[75703]:       <entry name='version'>0.0.0</entry>
Nov 10 14:56:02 user nova-compute[75703]:       <entry name='serial'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:02 user nova-compute[75703]:       <entry name='uuid'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:02 user nova-compute[75703]:       <entry name='family'>Virtual Machine</entry>
Nov 10 14:56:02 user nova-compute[75703]:     </system>
Nov 10 14:56:02 user nova-compute[75703]:   </sysinfo>
Nov 10 14:56:02 user nova-compute[75703]:   <os>
Nov 10 14:56:02 user nova-compute[75703]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 14:56:02 user nova-compute[75703]:     <boot dev='hd'/>
Nov 10 14:56:02 user nova-compute[75703]:     <smbios mode='sysinfo'/>
Nov 10 14:56:02 user nova-compute[75703]:   </os>
Nov 10 14:56:02 user nova-compute[75703]:   <features>
Nov 10 14:56:02 user nova-compute[75703]:     <acpi/>
Nov 10 14:56:02 user nova-compute[75703]:     <apic/>
Nov 10 14:56:02 user nova-compute[75703]:     <vmcoreinfo state='on'/>
Nov 10 14:56:02 user nova-compute[75703]:   </features>
Nov 10 14:56:02 user nova-compute[75703]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 14:56:02 user nova-compute[75703]:     <model fallback='forbid'>Nehalem</model>
Nov 10 14:56:02 user nova-compute[75703]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 14:56:02 user nova-compute[75703]:     <feature policy='require' name='vme'/>
Nov 10 14:56:02 user nova-compute[75703]:     <feature policy='require' name='x2apic'/>
Nov 10 14:56:02 user nova-compute[75703]:     <feature policy='require' name='hypervisor'/>
Nov 10 14:56:02 user nova-compute[75703]:   </cpu>
Nov 10 14:56:02 user nova-compute[75703]:   <clock offset='utc'>
Nov 10 14:56:02 user nova-compute[75703]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 14:56:02 user nova-compute[75703]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 14:56:02 user nova-compute[75703]:     <timer name='hpet' present='no'/>
Nov 10 14:56:02 user nova-compute[75703]:   </clock>
Nov 10 14:56:02 user nova-compute[75703]:   <on_poweroff>destroy</on_poweroff>
Nov 10 14:56:02 user nova-compute[75703]:   <on_reboot>restart</on_reboot>
Nov 10 14:56:02 user nova-compute[75703]:   <on_crash>destroy</on_crash>
Nov 10 14:56:02 user nova-compute[75703]:   <devices>
Nov 10 14:56:02 user nova-compute[75703]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 14:56:02 user nova-compute[75703]:     <disk type='file' device='disk'>
Nov 10 14:56:02 user nova-compute[75703]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 14:56:02 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk' index='2'/>
Nov 10 14:56:02 user nova-compute[75703]:       <backingStore type='file' index='3'>
Nov 10 14:56:02 user nova-compute[75703]:         <format type='raw'/>
Nov 10 14:56:02 user nova-compute[75703]:         <source file='/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef'/>
Nov 10 14:56:02 user nova-compute[75703]:         <backingStore/>
Nov 10 14:56:02 user nova-compute[75703]:       </backingStore>
Nov 10 14:56:02 user nova-compute[75703]:       <target dev='vda' bus='virtio'/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='virtio-disk0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </disk>
Nov 10 14:56:02 user nova-compute[75703]:     <disk type='file' device='cdrom'>
Nov 10 14:56:02 user nova-compute[75703]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 14:56:02 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config' index='1'/>
Nov 10 14:56:02 user nova-compute[75703]:       <backingStore/>
Nov 10 14:56:02 user nova-compute[75703]:       <target dev='hda' bus='ide'/>
Nov 10 14:56:02 user nova-compute[75703]:       <readonly/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='ide0-0-0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </disk>
Nov 10 14:56:02 user nova-compute[75703]:     <controller type='usb' index='0' model='none'>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='usb'/>
Nov 10 14:56:02 user nova-compute[75703]:     </controller>
Nov 10 14:56:02 user nova-compute[75703]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='pci.0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </controller>
Nov 10 14:56:02 user nova-compute[75703]:     <controller type='ide' index='0'>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='ide'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 14:56:02 user nova-compute[75703]:     </controller>
Nov 10 14:56:02 user nova-compute[75703]:     <interface type='ethernet'>
Nov 10 14:56:02 user nova-compute[75703]:       <mac address='fa:16:3e:62:33:07'/>
Nov 10 14:56:02 user nova-compute[75703]:       <target dev='tap47551cdd-8e'/>
Nov 10 14:56:02 user nova-compute[75703]:       <model type='virtio'/>
Nov 10 14:56:02 user nova-compute[75703]:       <mtu size='1442'/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='net0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </interface>
Nov 10 14:56:02 user nova-compute[75703]:     <interface type='ethernet'>
Nov 10 14:56:02 user nova-compute[75703]:       <mac address='fa:16:3e:b3:8d:10'/>
Nov 10 14:56:02 user nova-compute[75703]:       <target dev='tap3c6cac92-d5'/>
Nov 10 14:56:02 user nova-compute[75703]:       <model type='virtio'/>
Nov 10 14:56:02 user nova-compute[75703]:       <mtu size='1442'/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='net1'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </interface>
Nov 10 14:56:02 user nova-compute[75703]:     <serial type='pty'>
Nov 10 14:56:02 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:02 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:02 user nova-compute[75703]:       <target type='isa-serial' port='0'>
Nov 10 14:56:02 user nova-compute[75703]:         <model name='isa-serial'/>
Nov 10 14:56:02 user nova-compute[75703]:       </target>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </serial>
Nov 10 14:56:02 user nova-compute[75703]:     <console type='pty' tty='/dev/pts/9'>
Nov 10 14:56:02 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:02 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:02 user nova-compute[75703]:       <target type='serial' port='0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </console>
Nov 10 14:56:02 user nova-compute[75703]:     <input type='mouse' bus='ps2'>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='input0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </input>
Nov 10 14:56:02 user nova-compute[75703]:     <input type='keyboard' bus='ps2'>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='input1'/>
Nov 10 14:56:02 user nova-compute[75703]:     </input>
Nov 10 14:56:02 user nova-compute[75703]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 10 14:56:02 user nova-compute[75703]:       <listen type='address' address='0.0.0.0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </graphics>
Nov 10 14:56:02 user nova-compute[75703]:     <audio id='1' type='none'/>
Nov 10 14:56:02 user nova-compute[75703]:     <video>
Nov 10 14:56:02 user nova-compute[75703]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='video0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </video>
Nov 10 14:56:02 user nova-compute[75703]:     <memballoon model='virtio'>
Nov 10 14:56:02 user nova-compute[75703]:       <stats period='10'/>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='balloon0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </memballoon>
Nov 10 14:56:02 user nova-compute[75703]:     <rng model='virtio'>
Nov 10 14:56:02 user nova-compute[75703]:       <backend model='random'>/dev/urandom</backend>
Nov 10 14:56:02 user nova-compute[75703]:       <alias name='rng0'/>
Nov 10 14:56:02 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 14:56:02 user nova-compute[75703]:     </rng>
Nov 10 14:56:02 user nova-compute[75703]:   </devices>
Nov 10 14:56:02 user nova-compute[75703]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 14:56:02 user nova-compute[75703]:     <label>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</label>
Nov 10 14:56:02 user nova-compute[75703]:     <imagelabel>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</imagelabel>
Nov 10 14:56:02 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:02 user nova-compute[75703]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 14:56:02 user nova-compute[75703]:     <label>+64055:+108</label>
Nov 10 14:56:02 user nova-compute[75703]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 14:56:02 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:02 user nova-compute[75703]: </domain>
Nov 10 14:56:02 user nova-compute[75703]:  {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 14:56:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully detached device tap3c6cac92-d5 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the persistent domain config.
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] (1/8): Attempting to detach device tap3c6cac92-d5 with device alias net1 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] detach device xml: <interface type="ethernet">
Nov 10 14:56:02 user nova-compute[75703]:   <mac address="fa:16:3e:b3:8d:10"/>
Nov 10 14:56:02 user nova-compute[75703]:   <model type="virtio"/>
Nov 10 14:56:02 user nova-compute[75703]:   <mtu size="1442"/>
Nov 10 14:56:02 user nova-compute[75703]:   <target dev="tap3c6cac92-d5"/>
Nov 10 14:56:02 user nova-compute[75703]: </interface>
Nov 10 14:56:02 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Start waiting for the detach event from libvirt for device tap3c6cac92-d5 with device alias net1 for instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-bda45811-49de-4d3d-8df9-19430f72d14a req-bb64bf69-2c1c-47ec-83c7-5e1d5c27b8cf service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-unplugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bda45811-49de-4d3d-8df9-19430f72d14a req-bb64bf69-2c1c-47ec-83c7-5e1d5c27b8cf service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bda45811-49de-4d3d-8df9-19430f72d14a req-bb64bf69-2c1c-47ec-83c7-5e1d5c27b8cf service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bda45811-49de-4d3d-8df9-19430f72d14a req-bb64bf69-2c1c-47ec-83c7-5e1d5c27b8cf service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-bda45811-49de-4d3d-8df9-19430f72d14a req-bb64bf69-2c1c-47ec-83c7-5e1d5c27b8cf service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-unplugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:02 user nova-compute[75703]: WARNING nova.compute.manager [req-bda45811-49de-4d3d-8df9-19430f72d14a req-bb64bf69-2c1c-47ec-83c7-5e1d5c27b8cf service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-unplugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 for instance with vm_state active and task_state None.
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "e1842482-4120-40ff-843d-6395f6b14960" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-d4aa903c-b1fb-4f08-a64e-f62cb5e62818 req-1b8f88fa-b0b1-446e-a0ae-e4a903004b06 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d4aa903c-b1fb-4f08-a64e-f62cb5e62818 req-1b8f88fa-b0b1-446e-a0ae-e4a903004b06 service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d4aa903c-b1fb-4f08-a64e-f62cb5e62818 req-1b8f88fa-b0b1-446e-a0ae-e4a903004b06 service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d4aa903c-b1fb-4f08-a64e-f62cb5e62818 req-1b8f88fa-b0b1-446e-a0ae-e4a903004b06 service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-d4aa903c-b1fb-4f08-a64e-f62cb5e62818 req-1b8f88fa-b0b1-446e-a0ae-e4a903004b06 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:04 user nova-compute[75703]: WARNING nova.compute.manager [req-d4aa903c-b1fb-4f08-a64e-f62cb5e62818 req-1b8f88fa-b0b1-446e-a0ae-e4a903004b06 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-plugged-3c6cac92-d56d-4318-a315-97dcb51b6bc6 for instance with vm_state active and task_state None.
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:56:04 user nova-compute[75703]: INFO nova.compute.claims [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Claim successful on node user
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.889s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.581s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:06 user nova-compute[75703]: INFO nova.compute.manager [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Detaching volume ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.policy [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90957e8164224a1285c067f0313178a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19b6b93f7b4e6dbe0ded4d084792f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:56:06 user nova-compute[75703]: INFO nova.virt.block_device [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Booting with volume-backed-image 424c839a-ae27-4ecf-b640-8404a9fc9821 at /dev/vda
Nov 10 14:56:06 user nova-compute[75703]: INFO nova.virt.block_device [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Attempting to driver detach volume ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 from mountpoint /dev/vdb
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Attempting to detach device vdb from instance 0b071772-83ac-4848-b735-9dcfd41ee88a from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:56:06 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:56:06 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 14:56:06 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:56:06 user nova-compute[75703]:   <serial>ad7a55cb-38f3-4c16-b9af-25abfbcbbe31</serial>
Nov 10 14:56:06 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 14:56:06 user nova-compute[75703]: </disk>
Nov 10 14:56:06 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:56:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully detached device vdb from instance 0b071772-83ac-4848-b735-9dcfd41ee88a from the persistent domain config.
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b071772-83ac-4848-b735-9dcfd41ee88a from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:56:06 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:56:06 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 14:56:06 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:56:06 user nova-compute[75703]:   <serial>ad7a55cb-38f3-4c16-b9af-25abfbcbbe31</serial>
Nov 10 14:56:06 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 14:56:06 user nova-compute[75703]: </disk>
Nov 10 14:56:06 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Successfully created port: 539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Successfully updated port: 539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-changed-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Refreshing instance network info cache due to event network-changed-539018f0-1a3d-4d66-8953-2dfe71dbff34. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] Acquiring lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updating instance_info_cache with network_info: [{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance network_info: |[{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] Acquired lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Refreshing network info cache for port 539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:56:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:56:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7318MB free_disk=24.87698745727539GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updated VIF entry in instance network info cache for port 539018f0-1a3d-4d66-8953-2dfe71dbff34. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updating instance_info_cache with network_info: [{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0a8b14fc-522d-492e-b8e2-d328230016cb req-051bcc87-0257-4100-bb45-dd4934697fff service nova] Releasing lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0b071772-83ac-4848-b735-9dcfd41ee88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5224b8c5-414d-41d5-b973-71474c10a5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance adf2c465-ae08-4bc1-a3f4-ef2b6f830552 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:56:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:10 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:10 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:10 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:56:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Creating image(s)
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Ensure instance console log exists: /opt/stack/data/nova/instances/adf2c465-ae08-4bc1-a3f4-ef2b6f830552/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Start _get_guest_xml network_info=[{"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '5357d23d-1bd3-430b-a3ff-630611846237', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVIkUGiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adf2c465-ae08-4bc1-a3f4-ef2b6f830552', 'attached_at': '', 'detached_at': '', 'volume_id': '3b157c2e-131f-4143-be55-eca198f80683', 'serial': '3b157c2e-131f-4143-be55-eca198f80683'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:56:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:56:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVIkUGiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:56:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:56:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:56:11 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3086915f-0288-42f2-a6e3-e086549b2298]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:56:11 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e10b6e-e89f-4e86-857f-2b9b7ef4c603]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683] added
Nov 10 14:56:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19649b2-5b57-4180-ba77-2bc76da43826]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b3594-9503-4cbf-9d17-dde2f229b1fe]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVIkUGiT {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVIkUGiT" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[480de582-6f3c-4ba0-ae06-3028e4da05eb]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVIkUGiT'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ec36d-0d56-41ec-9a4e-261db05a3747]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a4a9bd-e8d9-406a-9c67-8e6645f424c5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:11 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:11 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:11 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:11 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:56:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --login" returned: 0 in 1.070s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fcd983-4afd-42b0-9ccc-9a3861d2917d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260]
Nov 10 14:56:13 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260] successful.
Nov 10 14:56:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ae35bc-d2ac-4281-a2c0-1c40d762bce8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc38bd51-5dde-486f-a7bc-7be40cfd2a67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:13 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:13 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:13 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:13 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:13 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:13 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:13 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.298s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e703a6d3-7078-457b-b4d0-d837e4aa0e7e]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:56:13 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVIkUGiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.335s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== connect_volume: return (2338ms) {'type': 'block', 'scsi_wwn': '23964616636643366', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964616636643366', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-801514877',display_name='tempest-TestVolumeBootPattern-server-801514877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-801514877',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-ev0t6bi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:55:23Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=adf2c465-ae08-4bc1-a3f4-ef2b6f830552,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'pci_devices' on Instance uuid adf2c465-ae08-4bc1-a3f4-ef2b6f830552 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:56:14 user nova-compute[75703]:   <uuid>adf2c465-ae08-4bc1-a3f4-ef2b6f830552</uuid>
Nov 10 14:56:14 user nova-compute[75703]:   <name>instance-0000001c</name>
Nov 10 14:56:14 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:56:14 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:56:14 user nova-compute[75703]:   <metadata>
Nov 10 14:56:14 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:14 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:56:14 user nova-compute[75703]:       <nova:name>tempest-TestVolumeBootPattern-server-801514877</nova:name>
Nov 10 14:56:14 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:56:11</nova:creationTime>
Nov 10 14:56:14 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:56:14 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:14 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:56:14 user nova-compute[75703]:       <nova:owner>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:user uuid="67a5a4845f164d8cba0951d82f2430e9">tempest-TestVolumeBootPattern-982390102-project-member</nova:user>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:project uuid="3c013cf84f8b414ba6d2d888ddc2ee1b">tempest-TestVolumeBootPattern-982390102</nova:project>
Nov 10 14:56:14 user nova-compute[75703]:       </nova:owner>
Nov 10 14:56:14 user nova-compute[75703]:       <nova:ports>
Nov 10 14:56:14 user nova-compute[75703]:         <nova:port uuid="0eac2a8e-edca-4788-848e-d50b69876ffc">
Nov 10 14:56:14 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 14:56:14 user nova-compute[75703]:         </nova:port>
Nov 10 14:56:14 user nova-compute[75703]:       </nova:ports>
Nov 10 14:56:14 user nova-compute[75703]:     </nova:instance>
Nov 10 14:56:14 user nova-compute[75703]:   </metadata>
Nov 10 14:56:14 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:56:14 user nova-compute[75703]:     <system>
Nov 10 14:56:14 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:56:14 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:56:14 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:56:14 user nova-compute[75703]:       <entry name="serial">adf2c465-ae08-4bc1-a3f4-ef2b6f830552</entry>
Nov 10 14:56:14 user nova-compute[75703]:       <entry name="uuid">adf2c465-ae08-4bc1-a3f4-ef2b6f830552</entry>
Nov 10 14:56:14 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:56:14 user nova-compute[75703]:     </system>
Nov 10 14:56:14 user nova-compute[75703]:   </sysinfo>
Nov 10 14:56:14 user nova-compute[75703]:   <os>
Nov 10 14:56:14 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:56:14 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:56:14 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:56:14 user nova-compute[75703]:   </os>
Nov 10 14:56:14 user nova-compute[75703]:   <features>
Nov 10 14:56:14 user nova-compute[75703]:     <acpi/>
Nov 10 14:56:14 user nova-compute[75703]:     <apic/>
Nov 10 14:56:14 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:56:14 user nova-compute[75703]:   </features>
Nov 10 14:56:14 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:56:14 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:56:14 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:56:14 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:56:14 user nova-compute[75703]:   </clock>
Nov 10 14:56:14 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:56:14 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:56:14 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:56:14 user nova-compute[75703]:   </cpu>
Nov 10 14:56:14 user nova-compute[75703]:   <devices>
Nov 10 14:56:14 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:56:14 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:56:14 user nova-compute[75703]:       <source dev="/dev/sdc"/>
Nov 10 14:56:14 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:56:14 user nova-compute[75703]:       <serial>3b157c2e-131f-4143-be55-eca198f80683</serial>
Nov 10 14:56:14 user nova-compute[75703]:     </disk>
Nov 10 14:56:14 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:56:14 user nova-compute[75703]:       <mac address="fa:16:3e:04:95:08"/>
Nov 10 14:56:14 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:56:14 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:56:14 user nova-compute[75703]:       <target dev="tap0eac2a8e-ed"/>
Nov 10 14:56:14 user nova-compute[75703]:     </interface>
Nov 10 14:56:14 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:56:14 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/adf2c465-ae08-4bc1-a3f4-ef2b6f830552/console.log" append="off"/>
Nov 10 14:56:14 user nova-compute[75703]:     </serial>
Nov 10 14:56:14 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:56:14 user nova-compute[75703]:     <video>
Nov 10 14:56:14 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:56:14 user nova-compute[75703]:     </video>
Nov 10 14:56:14 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:56:14 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:56:14 user nova-compute[75703]:     </rng>
Nov 10 14:56:14 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:56:14 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:56:14 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:56:14 user nova-compute[75703]:     </memballoon>
Nov 10 14:56:14 user nova-compute[75703]:   </devices>
Nov 10 14:56:14 user nova-compute[75703]: </domain>
Nov 10 14:56:14 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-801514877',display_name='tempest-TestVolumeBootPattern-server-801514877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-801514877',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-ev0t6bi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:55:23Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=adf2c465-ae08-4bc1-a3f4-ef2b6f830552,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG os_vif [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eac23621-57df-570d-877a-24690bcd4a34', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0eac2a8e-ed, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0eac2a8e-ed, col_values=(('qos', UUID('65883ce6-cfde-4edf-9d18-1c1a28f62fc7')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0eac2a8e-ed, col_values=(('external_ids', {'iface-id': '0eac2a8e-edca-4788-848e-d50b69876ffc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:95:08', 'vm-uuid': 'adf2c465-ae08-4bc1-a3f4-ef2b6f830552'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:14 user nova-compute[75703]: INFO os_vif [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed')
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No VIF found with MAC fa:16:3e:04:95:08, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:56:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-acf66211-9ccf-4f69-8e13-975d914a83b7 req-6ef80ae3-5fac-4fe4-b523-635caa7935e0 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-acf66211-9ccf-4f69-8e13-975d914a83b7 req-6ef80ae3-5fac-4fe4-b523-635caa7935e0 service nova] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-acf66211-9ccf-4f69-8e13-975d914a83b7 req-6ef80ae3-5fac-4fe4-b523-635caa7935e0 service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-acf66211-9ccf-4f69-8e13-975d914a83b7 req-6ef80ae3-5fac-4fe4-b523-635caa7935e0 service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-acf66211-9ccf-4f69-8e13-975d914a83b7 req-6ef80ae3-5fac-4fe4-b523-635caa7935e0 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] No waiting events found dispatching network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:15 user nova-compute[75703]: WARNING nova.compute.manager [req-acf66211-9ccf-4f69-8e13-975d914a83b7 req-6ef80ae3-5fac-4fe4-b523-635caa7935e0 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received unexpected event network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc for instance with vm_state building and task_state spawning.
Nov 10 14:56:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:56:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Instance spawned successfully.
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-d33d851e-7c99-46bf-9b12-5e256b1239c2 req-a62f4cb8-0dde-47f1-922d-8059b05a7907 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d33d851e-7c99-46bf-9b12-5e256b1239c2 req-a62f4cb8-0dde-47f1-922d-8059b05a7907 service nova] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d33d851e-7c99-46bf-9b12-5e256b1239c2 req-a62f4cb8-0dde-47f1-922d-8059b05a7907 service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d33d851e-7c99-46bf-9b12-5e256b1239c2 req-a62f4cb8-0dde-47f1-922d-8059b05a7907 service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-d33d851e-7c99-46bf-9b12-5e256b1239c2 req-a62f4cb8-0dde-47f1-922d-8059b05a7907 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] No waiting events found dispatching network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:17 user nova-compute[75703]: WARNING nova.compute.manager [req-d33d851e-7c99-46bf-9b12-5e256b1239c2 req-a62f4cb8-0dde-47f1-922d-8059b05a7907 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received unexpected event network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc for instance with vm_state building and task_state spawning.
Nov 10 14:56:17 user nova-compute[75703]: INFO nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 10 14:56:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:56:17 user nova-compute[75703]: INFO nova.compute.manager [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Took 55.42 seconds to build instance.
Nov 10 14:56:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7fc677a-7037-491f-870b-30e9f25a549f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.530s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Waiting for libvirt event about the detach of device tap3c6cac92-d5 with device alias net1 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f is timed out.
Nov 10 14:56:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface> {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 10 14:56:22 user nova-compute[75703]:   <name>instance-00000019</name>
Nov 10 14:56:22 user nova-compute[75703]:   <uuid>408dc601-9a7e-4af4-ba22-48c3d54eb66f</uuid>
Nov 10 14:56:22 user nova-compute[75703]:   <metadata>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:22 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:54:33</nova:creationTime>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:56:22 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:22 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:owner>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:56:22 user nova-compute[75703]:   </nova:owner>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:ports>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:56:22 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:56:22 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:port uuid="3c6cac92-d56d-4318-a315-97dcb51b6bc6">
Nov 10 14:56:22 user nova-compute[75703]:       <nova:ip type="fixed" address="10.10.10.109" ipVersion="4"/>
Nov 10 14:56:22 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:22 user nova-compute[75703]:   </nova:ports>
Nov 10 14:56:22 user nova-compute[75703]: </nova:instance>
Nov 10 14:56:22 user nova-compute[75703]:   </metadata>
Nov 10 14:56:22 user nova-compute[75703]:   <memory unit='KiB'>524288</memory>
Nov 10 14:56:22 user nova-compute[75703]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 14:56:22 user nova-compute[75703]:   <vcpu placement='static'>1</vcpu>
Nov 10 14:56:22 user nova-compute[75703]:   <resource>
Nov 10 14:56:22 user nova-compute[75703]:     <partition>/machine</partition>
Nov 10 14:56:22 user nova-compute[75703]:   </resource>
Nov 10 14:56:22 user nova-compute[75703]:   <sysinfo type='smbios'>
Nov 10 14:56:22 user nova-compute[75703]:     <system>
Nov 10 14:56:22 user nova-compute[75703]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 14:56:22 user nova-compute[75703]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 14:56:22 user nova-compute[75703]:       <entry name='version'>0.0.0</entry>
Nov 10 14:56:22 user nova-compute[75703]:       <entry name='serial'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:22 user nova-compute[75703]:       <entry name='uuid'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:22 user nova-compute[75703]:       <entry name='family'>Virtual Machine</entry>
Nov 10 14:56:22 user nova-compute[75703]:     </system>
Nov 10 14:56:22 user nova-compute[75703]:   </sysinfo>
Nov 10 14:56:22 user nova-compute[75703]:   <os>
Nov 10 14:56:22 user nova-compute[75703]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 14:56:22 user nova-compute[75703]:     <boot dev='hd'/>
Nov 10 14:56:22 user nova-compute[75703]:     <smbios mode='sysinfo'/>
Nov 10 14:56:22 user nova-compute[75703]:   </os>
Nov 10 14:56:22 user nova-compute[75703]:   <features>
Nov 10 14:56:22 user nova-compute[75703]:     <acpi/>
Nov 10 14:56:22 user nova-compute[75703]:     <apic/>
Nov 10 14:56:22 user nova-compute[75703]:     <vmcoreinfo state='on'/>
Nov 10 14:56:22 user nova-compute[75703]:   </features>
Nov 10 14:56:22 user nova-compute[75703]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 14:56:22 user nova-compute[75703]:     <model fallback='forbid'>Nehalem</model>
Nov 10 14:56:22 user nova-compute[75703]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 14:56:22 user nova-compute[75703]:     <feature policy='require' name='vme'/>
Nov 10 14:56:22 user nova-compute[75703]:     <feature policy='require' name='x2apic'/>
Nov 10 14:56:22 user nova-compute[75703]:     <feature policy='require' name='hypervisor'/>
Nov 10 14:56:22 user nova-compute[75703]:   </cpu>
Nov 10 14:56:22 user nova-compute[75703]:   <clock offset='utc'>
Nov 10 14:56:22 user nova-compute[75703]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 14:56:22 user nova-compute[75703]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 14:56:22 user nova-compute[75703]:     <timer name='hpet' present='no'/>
Nov 10 14:56:22 user nova-compute[75703]:   </clock>
Nov 10 14:56:22 user nova-compute[75703]:   <on_poweroff>destroy</on_poweroff>
Nov 10 14:56:22 user nova-compute[75703]:   <on_reboot>restart</on_reboot>
Nov 10 14:56:22 user nova-compute[75703]:   <on_crash>destroy</on_crash>
Nov 10 14:56:22 user nova-compute[75703]:   <devices>
Nov 10 14:56:22 user nova-compute[75703]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 14:56:22 user nova-compute[75703]:     <disk type='file' device='disk'>
Nov 10 14:56:22 user nova-compute[75703]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 14:56:22 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk' index='2'/>
Nov 10 14:56:22 user nova-compute[75703]:       <backingStore type='file' index='3'>
Nov 10 14:56:22 user nova-compute[75703]:         <format type='raw'/>
Nov 10 14:56:22 user nova-compute[75703]:         <source file='/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef'/>
Nov 10 14:56:22 user nova-compute[75703]:         <backingStore/>
Nov 10 14:56:22 user nova-compute[75703]:       </backingStore>
Nov 10 14:56:22 user nova-compute[75703]:       <target dev='vda' bus='virtio'/>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='virtio-disk0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </disk>
Nov 10 14:56:22 user nova-compute[75703]:     <disk type='file' device='cdrom'>
Nov 10 14:56:22 user nova-compute[75703]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 14:56:22 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config' index='1'/>
Nov 10 14:56:22 user nova-compute[75703]:       <backingStore/>
Nov 10 14:56:22 user nova-compute[75703]:       <target dev='hda' bus='ide'/>
Nov 10 14:56:22 user nova-compute[75703]:       <readonly/>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='ide0-0-0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </disk>
Nov 10 14:56:22 user nova-compute[75703]:     <controller type='usb' index='0' model='none'>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='usb'/>
Nov 10 14:56:22 user nova-compute[75703]:     </controller>
Nov 10 14:56:22 user nova-compute[75703]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='pci.0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </controller>
Nov 10 14:56:22 user nova-compute[75703]:     <controller type='ide' index='0'>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='ide'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 14:56:22 user nova-compute[75703]:     </controller>
Nov 10 14:56:22 user nova-compute[75703]:     <interface type='ethernet'>
Nov 10 14:56:22 user nova-compute[75703]:       <mac address='fa:16:3e:62:33:07'/>
Nov 10 14:56:22 user nova-compute[75703]:       <target dev='tap47551cdd-8e'/>
Nov 10 14:56:22 user nova-compute[75703]:       <model type='virtio'/>
Nov 10 14:56:22 user nova-compute[75703]:       <mtu size='1442'/>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='net0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </interface>
Nov 10 14:56:22 user nova-compute[75703]:     <serial type='pty'>
Nov 10 14:56:22 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:22 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:22 user nova-compute[75703]:       <target type='isa-serial' port='0'>
Nov 10 14:56:22 user nova-compute[75703]:         <model name='isa-serial'/>
Nov 10 14:56:22 user nova-compute[75703]:       </target>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </serial>
Nov 10 14:56:22 user nova-compute[75703]:     <console type='pty' tty='/dev/pts/9'>
Nov 10 14:56:22 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:22 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:22 user nova-compute[75703]:       <target type='serial' port='0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </console>
Nov 10 14:56:22 user nova-compute[75703]:     <input type='mouse' bus='ps2'>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='input0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </input>
Nov 10 14:56:22 user nova-compute[75703]:     <input type='keyboard' bus='ps2'>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='input1'/>
Nov 10 14:56:22 user nova-compute[75703]:     </input>
Nov 10 14:56:22 user nova-compute[75703]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 10 14:56:22 user nova-compute[75703]:       <listen type='address' address='0.0.0.0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </graphics>
Nov 10 14:56:22 user nova-compute[75703]:     <audio id='1' type='none'/>
Nov 10 14:56:22 user nova-compute[75703]:     <video>
Nov 10 14:56:22 user nova-compute[75703]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='video0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </video>
Nov 10 14:56:22 user nova-compute[75703]:     <memballoon model='virtio'>
Nov 10 14:56:22 user nova-compute[75703]:       <stats period='10'/>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='balloon0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </memballoon>
Nov 10 14:56:22 user nova-compute[75703]:     <rng model='virtio'>
Nov 10 14:56:22 user nova-compute[75703]:       <backend model='random'>/dev/urandom</backend>
Nov 10 14:56:22 user nova-compute[75703]:       <alias name='rng0'/>
Nov 10 14:56:22 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 14:56:22 user nova-compute[75703]:     </rng>
Nov 10 14:56:22 user nova-compute[75703]:   </devices>
Nov 10 14:56:22 user nova-compute[75703]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 14:56:22 user nova-compute[75703]:     <label>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</label>
Nov 10 14:56:22 user nova-compute[75703]:     <imagelabel>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</imagelabel>
Nov 10 14:56:22 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:22 user nova-compute[75703]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 14:56:22 user nova-compute[75703]:     <label>+64055:+108</label>
Nov 10 14:56:22 user nova-compute[75703]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 14:56:22 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:22 user nova-compute[75703]: </domain>
Nov 10 14:56:22 user nova-compute[75703]:  {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 14:56:22 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully detached device tap3c6cac92-d5 from instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f from the live domain config.
Nov 10 14:56:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG os_vif [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c6cac92-d5, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6495282a-192a-44bd-90ed-3f14d37a2165) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:22 user nova-compute[75703]: INFO os_vif [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5')
Nov 10 14:56:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:22 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:56:22</nova:creationTime>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:56:22 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:22 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:owner>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:56:22 user nova-compute[75703]:   </nova:owner>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:22 user nova-compute[75703]:   <nova:ports>
Nov 10 14:56:22 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:56:22 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:56:22 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:22 user nova-compute[75703]:   </nova:ports>
Nov 10 14:56:22 user nova-compute[75703]: </nova:instance>
Nov 10 14:56:22 user nova-compute[75703]:  {{(pid=75703) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-deleted-3c6cac92-d56d-4318-a315-97dcb51b6bc6 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:23 user nova-compute[75703]: INFO nova.compute.manager [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Neutron deleted interface 3c6cac92-d56d-4318-a315-97dcb51b6bc6; detaching it from the instance and deleting it from the info cache
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquired lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.objects.instance [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Lazy-loading 'system_metadata' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.objects.instance [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Lazy-loading 'flavor' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.objects.base [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Object Instance<408dc601-9a7e-4af4-ba22-48c3d54eb66f> lazy-loaded attributes: system_metadata,flavor {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Converting VIF {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface> {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 10 14:56:23 user nova-compute[75703]:   <name>instance-00000019</name>
Nov 10 14:56:23 user nova-compute[75703]:   <uuid>408dc601-9a7e-4af4-ba22-48c3d54eb66f</uuid>
Nov 10 14:56:23 user nova-compute[75703]:   <metadata>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:23 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:56:22</nova:creationTime>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:56:23 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:owner>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:owner>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:ports>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:56:23 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:56:23 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:ports>
Nov 10 14:56:23 user nova-compute[75703]: </nova:instance>
Nov 10 14:56:23 user nova-compute[75703]:   </metadata>
Nov 10 14:56:23 user nova-compute[75703]:   <memory unit='KiB'>524288</memory>
Nov 10 14:56:23 user nova-compute[75703]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 14:56:23 user nova-compute[75703]:   <vcpu placement='static'>1</vcpu>
Nov 10 14:56:23 user nova-compute[75703]:   <resource>
Nov 10 14:56:23 user nova-compute[75703]:     <partition>/machine</partition>
Nov 10 14:56:23 user nova-compute[75703]:   </resource>
Nov 10 14:56:23 user nova-compute[75703]:   <sysinfo type='smbios'>
Nov 10 14:56:23 user nova-compute[75703]:     <system>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='version'>0.0.0</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='serial'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='uuid'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='family'>Virtual Machine</entry>
Nov 10 14:56:23 user nova-compute[75703]:     </system>
Nov 10 14:56:23 user nova-compute[75703]:   </sysinfo>
Nov 10 14:56:23 user nova-compute[75703]:   <os>
Nov 10 14:56:23 user nova-compute[75703]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 14:56:23 user nova-compute[75703]:     <boot dev='hd'/>
Nov 10 14:56:23 user nova-compute[75703]:     <smbios mode='sysinfo'/>
Nov 10 14:56:23 user nova-compute[75703]:   </os>
Nov 10 14:56:23 user nova-compute[75703]:   <features>
Nov 10 14:56:23 user nova-compute[75703]:     <acpi/>
Nov 10 14:56:23 user nova-compute[75703]:     <apic/>
Nov 10 14:56:23 user nova-compute[75703]:     <vmcoreinfo state='on'/>
Nov 10 14:56:23 user nova-compute[75703]:   </features>
Nov 10 14:56:23 user nova-compute[75703]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 14:56:23 user nova-compute[75703]:     <model fallback='forbid'>Nehalem</model>
Nov 10 14:56:23 user nova-compute[75703]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 14:56:23 user nova-compute[75703]:     <feature policy='require' name='vme'/>
Nov 10 14:56:23 user nova-compute[75703]:     <feature policy='require' name='x2apic'/>
Nov 10 14:56:23 user nova-compute[75703]:     <feature policy='require' name='hypervisor'/>
Nov 10 14:56:23 user nova-compute[75703]:   </cpu>
Nov 10 14:56:23 user nova-compute[75703]:   <clock offset='utc'>
Nov 10 14:56:23 user nova-compute[75703]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 14:56:23 user nova-compute[75703]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 14:56:23 user nova-compute[75703]:     <timer name='hpet' present='no'/>
Nov 10 14:56:23 user nova-compute[75703]:   </clock>
Nov 10 14:56:23 user nova-compute[75703]:   <on_poweroff>destroy</on_poweroff>
Nov 10 14:56:23 user nova-compute[75703]:   <on_reboot>restart</on_reboot>
Nov 10 14:56:23 user nova-compute[75703]:   <on_crash>destroy</on_crash>
Nov 10 14:56:23 user nova-compute[75703]:   <devices>
Nov 10 14:56:23 user nova-compute[75703]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 14:56:23 user nova-compute[75703]:     <disk type='file' device='disk'>
Nov 10 14:56:23 user nova-compute[75703]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 14:56:23 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk' index='2'/>
Nov 10 14:56:23 user nova-compute[75703]:       <backingStore type='file' index='3'>
Nov 10 14:56:23 user nova-compute[75703]:         <format type='raw'/>
Nov 10 14:56:23 user nova-compute[75703]:         <source file='/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef'/>
Nov 10 14:56:23 user nova-compute[75703]:         <backingStore/>
Nov 10 14:56:23 user nova-compute[75703]:       </backingStore>
Nov 10 14:56:23 user nova-compute[75703]:       <target dev='vda' bus='virtio'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='virtio-disk0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </disk>
Nov 10 14:56:23 user nova-compute[75703]:     <disk type='file' device='cdrom'>
Nov 10 14:56:23 user nova-compute[75703]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 14:56:23 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config' index='1'/>
Nov 10 14:56:23 user nova-compute[75703]:       <backingStore/>
Nov 10 14:56:23 user nova-compute[75703]:       <target dev='hda' bus='ide'/>
Nov 10 14:56:23 user nova-compute[75703]:       <readonly/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='ide0-0-0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </disk>
Nov 10 14:56:23 user nova-compute[75703]:     <controller type='usb' index='0' model='none'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='usb'/>
Nov 10 14:56:23 user nova-compute[75703]:     </controller>
Nov 10 14:56:23 user nova-compute[75703]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='pci.0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </controller>
Nov 10 14:56:23 user nova-compute[75703]:     <controller type='ide' index='0'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='ide'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 14:56:23 user nova-compute[75703]:     </controller>
Nov 10 14:56:23 user nova-compute[75703]:     <interface type='ethernet'>
Nov 10 14:56:23 user nova-compute[75703]:       <mac address='fa:16:3e:62:33:07'/>
Nov 10 14:56:23 user nova-compute[75703]:       <target dev='tap47551cdd-8e'/>
Nov 10 14:56:23 user nova-compute[75703]:       <model type='virtio'/>
Nov 10 14:56:23 user nova-compute[75703]:       <mtu size='1442'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='net0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </interface>
Nov 10 14:56:23 user nova-compute[75703]:     <serial type='pty'>
Nov 10 14:56:23 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:23 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:23 user nova-compute[75703]:       <target type='isa-serial' port='0'>
Nov 10 14:56:23 user nova-compute[75703]:         <model name='isa-serial'/>
Nov 10 14:56:23 user nova-compute[75703]:       </target>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </serial>
Nov 10 14:56:23 user nova-compute[75703]:     <console type='pty' tty='/dev/pts/9'>
Nov 10 14:56:23 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:23 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:23 user nova-compute[75703]:       <target type='serial' port='0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </console>
Nov 10 14:56:23 user nova-compute[75703]:     <input type='mouse' bus='ps2'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='input0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </input>
Nov 10 14:56:23 user nova-compute[75703]:     <input type='keyboard' bus='ps2'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='input1'/>
Nov 10 14:56:23 user nova-compute[75703]:     </input>
Nov 10 14:56:23 user nova-compute[75703]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 10 14:56:23 user nova-compute[75703]:       <listen type='address' address='0.0.0.0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </graphics>
Nov 10 14:56:23 user nova-compute[75703]:     <audio id='1' type='none'/>
Nov 10 14:56:23 user nova-compute[75703]:     <video>
Nov 10 14:56:23 user nova-compute[75703]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='video0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </video>
Nov 10 14:56:23 user nova-compute[75703]:     <memballoon model='virtio'>
Nov 10 14:56:23 user nova-compute[75703]:       <stats period='10'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='balloon0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </memballoon>
Nov 10 14:56:23 user nova-compute[75703]:     <rng model='virtio'>
Nov 10 14:56:23 user nova-compute[75703]:       <backend model='random'>/dev/urandom</backend>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='rng0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </rng>
Nov 10 14:56:23 user nova-compute[75703]:   </devices>
Nov 10 14:56:23 user nova-compute[75703]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 14:56:23 user nova-compute[75703]:     <label>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</label>
Nov 10 14:56:23 user nova-compute[75703]:     <imagelabel>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</imagelabel>
Nov 10 14:56:23 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:23 user nova-compute[75703]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 14:56:23 user nova-compute[75703]:     <label>+64055:+108</label>
Nov 10 14:56:23 user nova-compute[75703]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 14:56:23 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:23 user nova-compute[75703]: </domain>
Nov 10 14:56:23 user nova-compute[75703]:  {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface> {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b3:8d:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap3c6cac92-d5"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 10 14:56:23 user nova-compute[75703]:   <name>instance-00000019</name>
Nov 10 14:56:23 user nova-compute[75703]:   <uuid>408dc601-9a7e-4af4-ba22-48c3d54eb66f</uuid>
Nov 10 14:56:23 user nova-compute[75703]:   <metadata>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:23 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:56:22</nova:creationTime>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:56:23 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:owner>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:owner>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:ports>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:56:23 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:56:23 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:ports>
Nov 10 14:56:23 user nova-compute[75703]: </nova:instance>
Nov 10 14:56:23 user nova-compute[75703]:   </metadata>
Nov 10 14:56:23 user nova-compute[75703]:   <memory unit='KiB'>524288</memory>
Nov 10 14:56:23 user nova-compute[75703]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 14:56:23 user nova-compute[75703]:   <vcpu placement='static'>1</vcpu>
Nov 10 14:56:23 user nova-compute[75703]:   <resource>
Nov 10 14:56:23 user nova-compute[75703]:     <partition>/machine</partition>
Nov 10 14:56:23 user nova-compute[75703]:   </resource>
Nov 10 14:56:23 user nova-compute[75703]:   <sysinfo type='smbios'>
Nov 10 14:56:23 user nova-compute[75703]:     <system>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='version'>0.0.0</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='serial'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='uuid'>408dc601-9a7e-4af4-ba22-48c3d54eb66f</entry>
Nov 10 14:56:23 user nova-compute[75703]:       <entry name='family'>Virtual Machine</entry>
Nov 10 14:56:23 user nova-compute[75703]:     </system>
Nov 10 14:56:23 user nova-compute[75703]:   </sysinfo>
Nov 10 14:56:23 user nova-compute[75703]:   <os>
Nov 10 14:56:23 user nova-compute[75703]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 14:56:23 user nova-compute[75703]:     <boot dev='hd'/>
Nov 10 14:56:23 user nova-compute[75703]:     <smbios mode='sysinfo'/>
Nov 10 14:56:23 user nova-compute[75703]:   </os>
Nov 10 14:56:23 user nova-compute[75703]:   <features>
Nov 10 14:56:23 user nova-compute[75703]:     <acpi/>
Nov 10 14:56:23 user nova-compute[75703]:     <apic/>
Nov 10 14:56:23 user nova-compute[75703]:     <vmcoreinfo state='on'/>
Nov 10 14:56:23 user nova-compute[75703]:   </features>
Nov 10 14:56:23 user nova-compute[75703]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 14:56:23 user nova-compute[75703]:     <model fallback='forbid'>Nehalem</model>
Nov 10 14:56:23 user nova-compute[75703]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 14:56:23 user nova-compute[75703]:     <feature policy='require' name='vme'/>
Nov 10 14:56:23 user nova-compute[75703]:     <feature policy='require' name='x2apic'/>
Nov 10 14:56:23 user nova-compute[75703]:     <feature policy='require' name='hypervisor'/>
Nov 10 14:56:23 user nova-compute[75703]:   </cpu>
Nov 10 14:56:23 user nova-compute[75703]:   <clock offset='utc'>
Nov 10 14:56:23 user nova-compute[75703]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 14:56:23 user nova-compute[75703]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 14:56:23 user nova-compute[75703]:     <timer name='hpet' present='no'/>
Nov 10 14:56:23 user nova-compute[75703]:   </clock>
Nov 10 14:56:23 user nova-compute[75703]:   <on_poweroff>destroy</on_poweroff>
Nov 10 14:56:23 user nova-compute[75703]:   <on_reboot>restart</on_reboot>
Nov 10 14:56:23 user nova-compute[75703]:   <on_crash>destroy</on_crash>
Nov 10 14:56:23 user nova-compute[75703]:   <devices>
Nov 10 14:56:23 user nova-compute[75703]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 14:56:23 user nova-compute[75703]:     <disk type='file' device='disk'>
Nov 10 14:56:23 user nova-compute[75703]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 14:56:23 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk' index='2'/>
Nov 10 14:56:23 user nova-compute[75703]:       <backingStore type='file' index='3'>
Nov 10 14:56:23 user nova-compute[75703]:         <format type='raw'/>
Nov 10 14:56:23 user nova-compute[75703]:         <source file='/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef'/>
Nov 10 14:56:23 user nova-compute[75703]:         <backingStore/>
Nov 10 14:56:23 user nova-compute[75703]:       </backingStore>
Nov 10 14:56:23 user nova-compute[75703]:       <target dev='vda' bus='virtio'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='virtio-disk0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </disk>
Nov 10 14:56:23 user nova-compute[75703]:     <disk type='file' device='cdrom'>
Nov 10 14:56:23 user nova-compute[75703]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 14:56:23 user nova-compute[75703]:       <source file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/disk.config' index='1'/>
Nov 10 14:56:23 user nova-compute[75703]:       <backingStore/>
Nov 10 14:56:23 user nova-compute[75703]:       <target dev='hda' bus='ide'/>
Nov 10 14:56:23 user nova-compute[75703]:       <readonly/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='ide0-0-0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </disk>
Nov 10 14:56:23 user nova-compute[75703]:     <controller type='usb' index='0' model='none'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='usb'/>
Nov 10 14:56:23 user nova-compute[75703]:     </controller>
Nov 10 14:56:23 user nova-compute[75703]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='pci.0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </controller>
Nov 10 14:56:23 user nova-compute[75703]:     <controller type='ide' index='0'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='ide'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 14:56:23 user nova-compute[75703]:     </controller>
Nov 10 14:56:23 user nova-compute[75703]:     <interface type='ethernet'>
Nov 10 14:56:23 user nova-compute[75703]:       <mac address='fa:16:3e:62:33:07'/>
Nov 10 14:56:23 user nova-compute[75703]:       <target dev='tap47551cdd-8e'/>
Nov 10 14:56:23 user nova-compute[75703]:       <model type='virtio'/>
Nov 10 14:56:23 user nova-compute[75703]:       <mtu size='1442'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='net0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </interface>
Nov 10 14:56:23 user nova-compute[75703]:     <serial type='pty'>
Nov 10 14:56:23 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:23 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:23 user nova-compute[75703]:       <target type='isa-serial' port='0'>
Nov 10 14:56:23 user nova-compute[75703]:         <model name='isa-serial'/>
Nov 10 14:56:23 user nova-compute[75703]:       </target>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </serial>
Nov 10 14:56:23 user nova-compute[75703]:     <console type='pty' tty='/dev/pts/9'>
Nov 10 14:56:23 user nova-compute[75703]:       <source path='/dev/pts/9'/>
Nov 10 14:56:23 user nova-compute[75703]:       <log file='/opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f/console.log' append='off'/>
Nov 10 14:56:23 user nova-compute[75703]:       <target type='serial' port='0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='serial0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </console>
Nov 10 14:56:23 user nova-compute[75703]:     <input type='mouse' bus='ps2'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='input0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </input>
Nov 10 14:56:23 user nova-compute[75703]:     <input type='keyboard' bus='ps2'>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='input1'/>
Nov 10 14:56:23 user nova-compute[75703]:     </input>
Nov 10 14:56:23 user nova-compute[75703]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 10 14:56:23 user nova-compute[75703]:       <listen type='address' address='0.0.0.0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </graphics>
Nov 10 14:56:23 user nova-compute[75703]:     <audio id='1' type='none'/>
Nov 10 14:56:23 user nova-compute[75703]:     <video>
Nov 10 14:56:23 user nova-compute[75703]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='video0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </video>
Nov 10 14:56:23 user nova-compute[75703]:     <memballoon model='virtio'>
Nov 10 14:56:23 user nova-compute[75703]:       <stats period='10'/>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='balloon0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </memballoon>
Nov 10 14:56:23 user nova-compute[75703]:     <rng model='virtio'>
Nov 10 14:56:23 user nova-compute[75703]:       <backend model='random'>/dev/urandom</backend>
Nov 10 14:56:23 user nova-compute[75703]:       <alias name='rng0'/>
Nov 10 14:56:23 user nova-compute[75703]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 14:56:23 user nova-compute[75703]:     </rng>
Nov 10 14:56:23 user nova-compute[75703]:   </devices>
Nov 10 14:56:23 user nova-compute[75703]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 14:56:23 user nova-compute[75703]:     <label>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</label>
Nov 10 14:56:23 user nova-compute[75703]:     <imagelabel>libvirt-408dc601-9a7e-4af4-ba22-48c3d54eb66f</imagelabel>
Nov 10 14:56:23 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:23 user nova-compute[75703]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 14:56:23 user nova-compute[75703]:     <label>+64055:+108</label>
Nov 10 14:56:23 user nova-compute[75703]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 14:56:23 user nova-compute[75703]:   </seclabel>
Nov 10 14:56:23 user nova-compute[75703]: </domain>
Nov 10 14:56:23 user nova-compute[75703]:  {{(pid=75703) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 14:56:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Detaching interface fa:16:3e:b3:8d:10 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap3c6cac92-d5' not found.
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Converting VIF {"id": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "address": "fa:16:3e:b3:8d:10", "network": {"id": "3fcbda13-fb98-4f42-ad2c-c58bac317399", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1498671519", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6cac92-d5", "ovs_interfaceid": "3c6cac92-d56d-4318-a315-97dcb51b6bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG os_vif [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c6cac92-d5, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:56:23 user nova-compute[75703]: INFO os_vif [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8d:10,bridge_name='br-int',has_traffic_filtering=True,id=3c6cac92-d56d-4318-a315-97dcb51b6bc6,network=Network(3fcbda13-fb98-4f42-ad2c-c58bac317399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6cac92-d5')
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [req-d524d61c-93df-48c2-acba-f0bd070a4cf4 req-a23bd4a8-055f-4ece-94aa-2f5f36aea996 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:23 user nova-compute[75703]:   <nova:package version="0.0.0"/>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:name>tempest-device-tagging-server-1315042696</nova:name>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:creationTime>2023-11-10 14:56:23</nova:creationTime>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:flavor name="m1.tiny">
Nov 10 14:56:23 user nova-compute[75703]:     <nova:memory>512</nova:memory>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:disk>1</nova:disk>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:swap>0</nova:swap>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:flavor>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:owner>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:user uuid="b78d2e0b1bcb4f8f988203951bee984c">tempest-TaggedAttachmentsTest-95884982-project-member</nova:user>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:project uuid="f53005799e814ffaa5cbf22041cfe1b7">tempest-TaggedAttachmentsTest-95884982</nova:project>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:owner>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:23 user nova-compute[75703]:   <nova:ports>
Nov 10 14:56:23 user nova-compute[75703]:     <nova:port uuid="47551cdd-8e4e-4435-937a-697529c6f13b">
Nov 10 14:56:23 user nova-compute[75703]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 14:56:23 user nova-compute[75703]:     </nova:port>
Nov 10 14:56:23 user nova-compute[75703]:   </nova:ports>
Nov 10 14:56:23 user nova-compute[75703]: </nova:instance>
Nov 10 14:56:23 user nova-compute[75703]:  {{(pid=75703) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 14:56:23 user nova-compute[75703]: INFO nova.network.neutron [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Port 3c6cac92-d56d-4318-a315-97dcb51b6bc6 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 10 14:56:23 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [{"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Releasing lock "refresh_cache-408dc601-9a7e-4af4-ba22-48c3d54eb66f" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:56:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0be60bda-34c6-4935-983f-e447a2c72d49 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "interface-408dc601-9a7e-4af4-ba22-48c3d54eb66f-3c6cac92-d56d-4318-a315-97dcb51b6bc6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.490s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:27 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b071772-83ac-4848-b735-9dcfd41ee88a is timed out.
Nov 10 14:56:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully detached device vdb from instance 0b071772-83ac-4848-b735-9dcfd41ee88a from the live domain config.
Nov 10 14:56:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVjODHzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:56:27 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7bd753-8328-4247-87a3-70295e338290]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:56:27 user nova-compute[75703]: No targets found.
Nov 10 14:56:27 user nova-compute[75703]: iSNS:
Nov 10 14:56:27 user nova-compute[75703]: No targets found.
Nov 10 14:56:27 user nova-compute[75703]: STATIC:
Nov 10 14:56:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683
Nov 10 14:56:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9
Nov 10 14:56:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:56:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:27 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31
Nov 10 14:56:27 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:56:27 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:56:27 user nova-compute[75703]: FIRMWARE:
Nov 10 14:56:27 user nova-compute[75703]: No targets found.
Nov 10 14:56:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:56:27 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:56:27 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff70ba5-1254-4348-a237-ae104503a246]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f20e99-1fcb-49c3-adbe-56aafab1c3e6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:27 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:27 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:27 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:27 user nova-compute[75703]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 (non-flash)
Nov 10 14:56:27 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:27 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4c4283880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31'): ({'sdd'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Removing single pathed devices sdd {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9631cb-27f6-48a5-b7e9-ccd1becfc6fb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b25e1a-0b4c-467c-b58f-b87bf3236085]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flushing IO for device /dev/sdd {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56bd940-c65a-460b-bac0-7ca2d9c5505d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.utils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f72c48-43fb-4492-9021-92b345a8d378]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be6e6d-cd9e-4e50-8849-dc71c8c446bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e2867-f409-41d9-8195-68aa57529619]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be6e978-5c48-4fba-a732-b610bf1160d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be46792-663c-4073-89c5-c9fc818e4d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea644e88-d642-41f3-99f4-6ef8dcebc803]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a3605-9429-44e3-af9a-25fe28314da6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260]
Nov 10 14:56:27 user nova-compute[75703]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31, portal: 172.16.0.220,3260] successful.
Nov 10 14:56:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:56:27 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e97b3-a11f-4261-ae9e-e18470f4f553]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.utils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updating existing volume attachment record: 5efc89dd-d8f4-43f7-8a55-62b4bba637da {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad7a55cb-38f3-4c16-b9af-25abfbcbbe31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cfbbe8-364f-46f8-874b-4cba729f58d6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== disconnect_volume: return (361ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:56:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:28 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'flavor' on Instance uuid 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a7d3c36a-6708-46f9-8706-f66ee0206a55 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.466s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 14:56:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:56:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 14:56:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:52 user nova-compute[75703]: INFO nova.compute.manager [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Terminating instance
Nov 10 14:56:52 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:56:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-d61e4ccb-74eb-4527-97e5-622ec5f5fc52 req-95f4c6ff-1ff0-4e8c-9d74-be505fe7c45e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-unplugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d61e4ccb-74eb-4527-97e5-622ec5f5fc52 req-95f4c6ff-1ff0-4e8c-9d74-be505fe7c45e service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d61e4ccb-74eb-4527-97e5-622ec5f5fc52 req-95f4c6ff-1ff0-4e8c-9d74-be505fe7c45e service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d61e4ccb-74eb-4527-97e5-622ec5f5fc52 req-95f4c6ff-1ff0-4e8c-9d74-be505fe7c45e service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-d61e4ccb-74eb-4527-97e5-622ec5f5fc52 req-95f4c6ff-1ff0-4e8c-9d74-be505fe7c45e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-unplugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-d61e4ccb-74eb-4527-97e5-622ec5f5fc52 req-95f4c6ff-1ff0-4e8c-9d74-be505fe7c45e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-unplugged-47551cdd-8e4e-4435-937a-697529c6f13b for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:56:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Instance destroyed successfully.
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.objects.instance [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lazy-loading 'resources' on Instance uuid 408dc601-9a7e-4af4-ba22-48c3d54eb66f {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1315042696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1315042696',id=25,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIEtTGEDt7PAnlO9QaJtDZspoI0wd66HVz2CpNBexYK3IFzt6D//gRiJC3p1hw9BnIXQHHm0GFpsijf4L6wCaoWKiI2wOvBqOE4OuxgF7JNo/+n4x0yzaylCaUCj/cWPQ==',key_name='tempest-keypair-1940922886',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f53005799e814ffaa5cbf22041cfe1b7',ramdisk_id='',reservation_id='r-4qdzq9xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-95884982',owner_user_name='tempest-TaggedAttachmentsTest-95884982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78d2e0b1bcb4f8f988203951bee984c',uuid=408dc601-9a7e-4af4-ba22-48c3d54eb66f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converting VIF {"id": "47551cdd-8e4e-4435-937a-697529c6f13b", "address": "fa:16:3e:62:33:07", "network": {"id": "7b804899-62f4-465d-848e-57ccc4208fce", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1282341252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f53005799e814ffaa5cbf22041cfe1b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47551cdd-8e", "ovs_interfaceid": "47551cdd-8e4e-4435-937a-697529c6f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG os_vif [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47551cdd-8e, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40833dcb-99d4-44b3-a450-bedd34e17390) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:53 user nova-compute[75703]: INFO os_vif [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:33:07,bridge_name='br-int',has_traffic_filtering=True,id=47551cdd-8e4e-4435-937a-697529c6f13b,network=Network(7b804899-62f4-465d-848e-57ccc4208fce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47551cdd-8e')
Nov 10 14:56:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Deleting instance files /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f_del
Nov 10 14:56:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Deletion of /opt/stack/data/nova/instances/408dc601-9a7e-4af4-ba22-48c3d54eb66f_del complete
Nov 10 14:56:53 user nova-compute[75703]: INFO nova.compute.manager [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 14:56:53 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:56:53 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:56:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:54 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:54 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Took 0.92 seconds to deallocate network for instance.
Nov 10 14:56:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-91cc4cbd-ccc4-4019-aa0f-70418e3f8bb5 req-27edaa7b-e3bd-4d1a-8c06-431971de0c1e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-deleted-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:54 user nova-compute[75703]: INFO nova.compute.manager [req-91cc4cbd-ccc4-4019-aa0f-70418e3f8bb5 req-27edaa7b-e3bd-4d1a-8c06-431971de0c1e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Neutron deleted interface 47551cdd-8e4e-4435-937a-697529c6f13b; detaching it from the instance and deleting it from the info cache
Nov 10 14:56:54 user nova-compute[75703]: DEBUG nova.network.neutron [req-91cc4cbd-ccc4-4019-aa0f-70418e3f8bb5 req-27edaa7b-e3bd-4d1a-8c06-431971de0c1e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-91cc4cbd-ccc4-4019-aa0f-70418e3f8bb5 req-27edaa7b-e3bd-4d1a-8c06-431971de0c1e service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Detach interface failed, port_id=47551cdd-8e4e-4435-937a-697529c6f13b, reason: Instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:56:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:55 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Deleted allocations for instance 408dc601-9a7e-4af4-ba22-48c3d54eb66f
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-01c71772-9587-4d14-afc2-bc6931d8df6c req-5b6a6e4d-6d7d-43a4-bcc8-6f01206d488b service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received event network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-01c71772-9587-4d14-afc2-bc6931d8df6c req-5b6a6e4d-6d7d-43a4-bcc8-6f01206d488b service nova] Acquiring lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-01c71772-9587-4d14-afc2-bc6931d8df6c req-5b6a6e4d-6d7d-43a4-bcc8-6f01206d488b service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-01c71772-9587-4d14-afc2-bc6931d8df6c req-5b6a6e4d-6d7d-43a4-bcc8-6f01206d488b service nova] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-01c71772-9587-4d14-afc2-bc6931d8df6c req-5b6a6e4d-6d7d-43a4-bcc8-6f01206d488b service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] No waiting events found dispatching network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:55 user nova-compute[75703]: WARNING nova.compute.manager [req-01c71772-9587-4d14-afc2-bc6931d8df6c req-5b6a6e4d-6d7d-43a4-bcc8-6f01206d488b service nova] [instance: 408dc601-9a7e-4af4-ba22-48c3d54eb66f] Received unexpected event network-vif-plugged-47551cdd-8e4e-4435-937a-697529c6f13b for instance with vm_state deleted and task_state None.
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb7f6885-c48d-4aa1-8675-73466a0910e3 tempest-TaggedAttachmentsTest-95884982 tempest-TaggedAttachmentsTest-95884982-project-member] Lock "408dc601-9a7e-4af4-ba22-48c3d54eb66f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.644s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:56:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Creating image(s)
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Ensure instance console log exists: /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Start _get_guest_xml network_info=[{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5efc89dd-d8f4-43f7-8a55-62b4bba637da', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1842482-4120-40ff-843d-6395f6b14960', 'attached_at': '', 'detached_at': '', 'volume_id': '62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'serial': '62b52bf0-2fab-418c-b846-8e9ddf1e58b9'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:56:55 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:56:55 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:56:55 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:56:55 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:56:55 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec0b98c-01cf-48d9-8090-6c5d8a993fe3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:56:55 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1fc3d0-2157-40a2-bdb1-a520053c9e74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9] added
Nov 10 14:56:55 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf03317-d2f0-490a-9ee7-e4464dbac327]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d79c4f-497b-4920-8f75-d616b68e4e77]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZCcfmxR {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZCcfmxR" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[97577b4a-3f3e-4ea2-89b4-e5ff396b22df]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JZCcfmxR'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d2d798-07cc-4b3a-9656-cd4eec4d241e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[49016f31-ff86-4dbb-8a75-b8f0cec4f17c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2c8de3-4ac1-407d-991d-0d5d6ef09d73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260]
Nov 10 14:56:56 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260] successful.
Nov 10 14:56:56 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38fba15-615e-44b8-9d35-b1c3aed5f2af]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a8f64c-f494-499b-a763-e6db06e0425e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:56:56 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd992c-3962-4676-a668-7c36e3dd9782]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:56 user nova-compute[75703]: INFO nova.compute.manager [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Terminating instance
Nov 10 14:56:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0d29d5b-92f4-4745-8743-0811b696d4eb req-7535ba0d-4ade-44c8-bc2c-a368f6b4dcc5 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0d29d5b-92f4-4745-8743-0811b696d4eb req-7535ba0d-4ade-44c8-bc2c-a368f6b4dcc5 service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0d29d5b-92f4-4745-8743-0811b696d4eb req-7535ba0d-4ade-44c8-bc2c-a368f6b4dcc5 service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0d29d5b-92f4-4745-8743-0811b696d4eb req-7535ba0d-4ade-44c8-bc2c-a368f6b4dcc5 service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0d29d5b-92f4-4745-8743-0811b696d4eb req-7535ba0d-4ade-44c8-bc2c-a368f6b4dcc5 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0d29d5b-92f4-4745-8743-0811b696d4eb req-7535ba0d-4ade-44c8-bc2c-a368f6b4dcc5 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-unplugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23362323264353033', 'path': '/dev/sdd'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362323264353033', 'path': '/dev/sdd'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71868614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71868614',id=29,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-8qu751zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:56:06Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=e1842482-4120-40ff-843d-6395f6b14960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'pci_devices' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:56:57 user nova-compute[75703]:   <uuid>e1842482-4120-40ff-843d-6395f6b14960</uuid>
Nov 10 14:56:57 user nova-compute[75703]:   <name>instance-0000001d</name>
Nov 10 14:56:57 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:56:57 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:56:57 user nova-compute[75703]:   <metadata>
Nov 10 14:56:57 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:56:57 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:56:57 user nova-compute[75703]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-71868614</nova:name>
Nov 10 14:56:57 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:56:55</nova:creationTime>
Nov 10 14:56:57 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:56:57 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:56:57 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:56:57 user nova-compute[75703]:       <nova:owner>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:user uuid="90957e8164224a1285c067f0313178a2">tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member</nova:user>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:project uuid="6b19b6b93f7b4e6dbe0ded4d084792f2">tempest-ServerBootFromVolumeStableRescueTest-2023657370</nova:project>
Nov 10 14:56:57 user nova-compute[75703]:       </nova:owner>
Nov 10 14:56:57 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:56:57 user nova-compute[75703]:       <nova:ports>
Nov 10 14:56:57 user nova-compute[75703]:         <nova:port uuid="539018f0-1a3d-4d66-8953-2dfe71dbff34">
Nov 10 14:56:57 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:56:57 user nova-compute[75703]:         </nova:port>
Nov 10 14:56:57 user nova-compute[75703]:       </nova:ports>
Nov 10 14:56:57 user nova-compute[75703]:     </nova:instance>
Nov 10 14:56:57 user nova-compute[75703]:   </metadata>
Nov 10 14:56:57 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:56:57 user nova-compute[75703]:     <system>
Nov 10 14:56:57 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:56:57 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:56:57 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:56:57 user nova-compute[75703]:       <entry name="serial">e1842482-4120-40ff-843d-6395f6b14960</entry>
Nov 10 14:56:57 user nova-compute[75703]:       <entry name="uuid">e1842482-4120-40ff-843d-6395f6b14960</entry>
Nov 10 14:56:57 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:56:57 user nova-compute[75703]:     </system>
Nov 10 14:56:57 user nova-compute[75703]:   </sysinfo>
Nov 10 14:56:57 user nova-compute[75703]:   <os>
Nov 10 14:56:57 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:56:57 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:56:57 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:56:57 user nova-compute[75703]:   </os>
Nov 10 14:56:57 user nova-compute[75703]:   <features>
Nov 10 14:56:57 user nova-compute[75703]:     <acpi/>
Nov 10 14:56:57 user nova-compute[75703]:     <apic/>
Nov 10 14:56:57 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:56:57 user nova-compute[75703]:   </features>
Nov 10 14:56:57 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:56:57 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:56:57 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:56:57 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:56:57 user nova-compute[75703]:   </clock>
Nov 10 14:56:57 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:56:57 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:56:57 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:56:57 user nova-compute[75703]:   </cpu>
Nov 10 14:56:57 user nova-compute[75703]:   <devices>
Nov 10 14:56:57 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:56:57 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:56:57 user nova-compute[75703]:       <source dev="/dev/sdd"/>
Nov 10 14:56:57 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:56:57 user nova-compute[75703]:       <serial>62b52bf0-2fab-418c-b846-8e9ddf1e58b9</serial>
Nov 10 14:56:57 user nova-compute[75703]:     </disk>
Nov 10 14:56:57 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:56:57 user nova-compute[75703]:       <mac address="fa:16:3e:be:bc:45"/>
Nov 10 14:56:57 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:56:57 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:56:57 user nova-compute[75703]:       <target dev="tap539018f0-1a"/>
Nov 10 14:56:57 user nova-compute[75703]:     </interface>
Nov 10 14:56:57 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:56:57 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/console.log" append="off"/>
Nov 10 14:56:57 user nova-compute[75703]:     </serial>
Nov 10 14:56:57 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:56:57 user nova-compute[75703]:     <video>
Nov 10 14:56:57 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:56:57 user nova-compute[75703]:     </video>
Nov 10 14:56:57 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:56:57 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:56:57 user nova-compute[75703]:     </rng>
Nov 10 14:56:57 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:56:57 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:56:57 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:56:57 user nova-compute[75703]:     </memballoon>
Nov 10 14:56:57 user nova-compute[75703]:   </devices>
Nov 10 14:56:57 user nova-compute[75703]: </domain>
Nov 10 14:56:57 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71868614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71868614',id=29,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-8qu751zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:56:06Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=e1842482-4120-40ff-843d-6395f6b14960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG os_vif [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52bbef33-adf7-58d6-a77c-0f0ebbcc8e2d', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap539018f0-1a, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap539018f0-1a, col_values=(('qos', UUID('684bc276-3cb4-437e-a55f-28815626f0fd')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap539018f0-1a, col_values=(('external_ids', {'iface-id': '539018f0-1a3d-4d66-8953-2dfe71dbff34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:bc:45', 'vm-uuid': 'e1842482-4120-40ff-843d-6395f6b14960'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: INFO os_vif [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a')
Nov 10 14:56:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Instance destroyed successfully.
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.objects.instance [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'resources' on Instance uuid 0b071772-83ac-4848-b735-9dcfd41ee88a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No VIF found with MAC fa:16:3e:be:bc:45, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T14:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993196221',display_name='tempest-ServerActionsTestOtherA-server-1577543893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993196221',id=19,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOXsfg8OtAF6y15f8pyf2zdKsfHHvx2Sl4DlV0LLsRlXzWk7nagjDQvEd+0CWh/8TFWwBen16W3DyFwmj7DfNKj73/gZHHXZoxnnPAJ3cPQ5Wjy8d1NpdmIwa4vcLAv4w==',key_name='tempest-keypair-2121173221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-m55zusr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=0b071772-83ac-4848-b735-9dcfd41ee88a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "3d2f146b-0393-4de8-9e6a-196f466b3872", "address": "fa:16:3e:4d:22:71", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d2f146b-03", "ovs_interfaceid": "3d2f146b-0393-4de8-9e6a-196f466b3872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG os_vif [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d2f146b-03, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e9589ad-a8f4-483d-bb78-503b62c9bb9b) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:57 user nova-compute[75703]: INFO os_vif [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:71,bridge_name='br-int',has_traffic_filtering=True,id=3d2f146b-0393-4de8-9e6a-196f466b3872,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d2f146b-03')
Nov 10 14:56:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Deleting instance files /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a_del
Nov 10 14:56:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Deletion of /opt/stack/data/nova/instances/0b071772-83ac-4848-b735-9dcfd41ee88a_del complete
Nov 10 14:56:57 user nova-compute[75703]: INFO nova.compute.manager [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 14:56:57 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:56:57 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-e7d84a39-55c2-4f30-9473-2ff7ce877760 req-45707da0-c8d1-4c13-93cb-cbd3ec90cd17 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-deleted-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:58 user nova-compute[75703]: INFO nova.compute.manager [req-e7d84a39-55c2-4f30-9473-2ff7ce877760 req-45707da0-c8d1-4c13-93cb-cbd3ec90cd17 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Neutron deleted interface 3d2f146b-0393-4de8-9e6a-196f466b3872; detaching it from the instance and deleting it from the info cache
Nov 10 14:56:58 user nova-compute[75703]: DEBUG nova.network.neutron [req-e7d84a39-55c2-4f30-9473-2ff7ce877760 req-45707da0-c8d1-4c13-93cb-cbd3ec90cd17 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-e7d84a39-55c2-4f30-9473-2ff7ce877760 req-45707da0-c8d1-4c13-93cb-cbd3ec90cd17 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Detach interface failed, port_id=3d2f146b-0393-4de8-9e6a-196f466b3872, reason: Instance 0b071772-83ac-4848-b735-9dcfd41ee88a could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 14:56:58 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Took 0.97 seconds to deallocate network for instance.
Nov 10 14:56:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:58 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-6777f521-a89c-4164-8014-2eb58bcadfbe req-46e105a2-0a8f-45cc-aa55-7133ab092642 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6777f521-a89c-4164-8014-2eb58bcadfbe req-46e105a2-0a8f-45cc-aa55-7133ab092642 service nova] Acquiring lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6777f521-a89c-4164-8014-2eb58bcadfbe req-46e105a2-0a8f-45cc-aa55-7133ab092642 service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6777f521-a89c-4164-8014-2eb58bcadfbe req-46e105a2-0a8f-45cc-aa55-7133ab092642 service nova] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-6777f521-a89c-4164-8014-2eb58bcadfbe req-46e105a2-0a8f-45cc-aa55-7133ab092642 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] No waiting events found dispatching network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:56:59 user nova-compute[75703]: WARNING nova.compute.manager [req-6777f521-a89c-4164-8014-2eb58bcadfbe req-46e105a2-0a8f-45cc-aa55-7133ab092642 service nova] [instance: 0b071772-83ac-4848-b735-9dcfd41ee88a] Received unexpected event network-vif-plugged-3d2f146b-0393-4de8-9e6a-196f466b3872 for instance with vm_state deleted and task_state None.
Nov 10 14:56:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:59 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Deleted allocations for instance 0b071772-83ac-4848-b735-9dcfd41ee88a
Nov 10 14:56:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-67fd0ea4-fac3-4580-a024-7a59d1f3c3b6 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "0b071772-83ac-4848-b735-9dcfd41ee88a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.695s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:56:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:00 user nova-compute[75703]: WARNING nova.compute.manager [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state building and task_state spawning.
Nov 10 14:57:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:00 user nova-compute[75703]: WARNING nova.compute.manager [req-0b3890ae-96a1-4fd0-8902-b0ab483b575b req-e9044d6f-d490-4a9a-936f-7f99fea93686 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state building and task_state spawning.
Nov 10 14:57:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:57:01 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance spawned successfully.
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:01 user nova-compute[75703]: INFO nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 10 14:57:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:57:01 user nova-compute[75703]: INFO nova.compute.manager [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Took 56.64 seconds to build instance.
Nov 10 14:57:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dddc0999-c2c9-4a46-9849-1554b485fdc8 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "e1842482-4120-40ff-843d-6395f6b14960" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.815s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:03 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:57:05 user nova-compute[75703]: INFO nova.compute.claims [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Claim successful on node user
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:57:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:57:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:57:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Creating image(s)
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "/opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "/opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "/opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG nova.policy [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9806be7af5fd410d971f2384899eab85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ca92ae18d432da1805be8bcdb88dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.242s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk 1073741824" returned: 0 in 0.083s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Successfully created port: e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Cannot resize image /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Ensure instance console log exists: /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Successfully updated port: e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "refresh_cache-92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquired lock "refresh_cache-92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-changed-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Refreshing instance network info cache due to event network-changed-e7f2fc4f-086b-43a4-9f63-307b86e67417. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] Acquiring lock "refresh_cache-92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Updating instance_info_cache with network_info: [{"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Releasing lock "refresh_cache-92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Instance network_info: |[{"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] Acquired lock "refresh_cache-92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Refreshing network info cache for port e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Start _get_guest_xml network_info=[{"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:57:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-83423106',display_name='tempest-ServersNegativeTestJSON-server-83423106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-83423106',id=30,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ca92ae18d432da1805be8bcdb88dd',ramdisk_id='',reservation_id='r-l6j7q0aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2142185333',owner_user_name='tempest-ServersNegativeTestJSON-2142185333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:57:06Z,user_data=None,user_id='9806be7af5fd410d971f2384899eab85',uuid=92d1fcb9-de3a-4b51-97bb-81ce39e8dd27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converting VIF {"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lazy-loading 'pci_devices' on Instance uuid 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:57:08 user nova-compute[75703]:   <uuid>92d1fcb9-de3a-4b51-97bb-81ce39e8dd27</uuid>
Nov 10 14:57:08 user nova-compute[75703]:   <name>instance-0000001e</name>
Nov 10 14:57:08 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:57:08 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:57:08 user nova-compute[75703]:   <metadata>
Nov 10 14:57:08 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:57:08 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:57:08 user nova-compute[75703]:       <nova:name>tempest-ServersNegativeTestJSON-server-83423106</nova:name>
Nov 10 14:57:08 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:57:08</nova:creationTime>
Nov 10 14:57:08 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:57:08 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:57:08 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:57:08 user nova-compute[75703]:       <nova:owner>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:user uuid="9806be7af5fd410d971f2384899eab85">tempest-ServersNegativeTestJSON-2142185333-project-member</nova:user>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:project uuid="482ca92ae18d432da1805be8bcdb88dd">tempest-ServersNegativeTestJSON-2142185333</nova:project>
Nov 10 14:57:08 user nova-compute[75703]:       </nova:owner>
Nov 10 14:57:08 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:57:08 user nova-compute[75703]:       <nova:ports>
Nov 10 14:57:08 user nova-compute[75703]:         <nova:port uuid="e7f2fc4f-086b-43a4-9f63-307b86e67417">
Nov 10 14:57:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 14:57:08 user nova-compute[75703]:         </nova:port>
Nov 10 14:57:08 user nova-compute[75703]:       </nova:ports>
Nov 10 14:57:08 user nova-compute[75703]:     </nova:instance>
Nov 10 14:57:08 user nova-compute[75703]:   </metadata>
Nov 10 14:57:08 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:57:08 user nova-compute[75703]:     <system>
Nov 10 14:57:08 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:57:08 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:57:08 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:57:08 user nova-compute[75703]:       <entry name="serial">92d1fcb9-de3a-4b51-97bb-81ce39e8dd27</entry>
Nov 10 14:57:08 user nova-compute[75703]:       <entry name="uuid">92d1fcb9-de3a-4b51-97bb-81ce39e8dd27</entry>
Nov 10 14:57:08 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:57:08 user nova-compute[75703]:     </system>
Nov 10 14:57:08 user nova-compute[75703]:   </sysinfo>
Nov 10 14:57:08 user nova-compute[75703]:   <os>
Nov 10 14:57:08 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:57:08 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:57:08 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:57:08 user nova-compute[75703]:   </os>
Nov 10 14:57:08 user nova-compute[75703]:   <features>
Nov 10 14:57:08 user nova-compute[75703]:     <acpi/>
Nov 10 14:57:08 user nova-compute[75703]:     <apic/>
Nov 10 14:57:08 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:57:08 user nova-compute[75703]:   </features>
Nov 10 14:57:08 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:57:08 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:57:08 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:57:08 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:57:08 user nova-compute[75703]:   </clock>
Nov 10 14:57:08 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:57:08 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:57:08 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:57:08 user nova-compute[75703]:   </cpu>
Nov 10 14:57:08 user nova-compute[75703]:   <devices>
Nov 10 14:57:08 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:57:08 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:57:08 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk"/>
Nov 10 14:57:08 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:57:08 user nova-compute[75703]:     </disk>
Nov 10 14:57:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:57:08 user nova-compute[75703]:       <mac address="fa:16:3e:3c:d0:80"/>
Nov 10 14:57:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:57:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:57:08 user nova-compute[75703]:       <target dev="tape7f2fc4f-08"/>
Nov 10 14:57:08 user nova-compute[75703]:     </interface>
Nov 10 14:57:08 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:57:08 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/console.log" append="off"/>
Nov 10 14:57:08 user nova-compute[75703]:     </serial>
Nov 10 14:57:08 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:57:08 user nova-compute[75703]:     <video>
Nov 10 14:57:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:57:08 user nova-compute[75703]:     </video>
Nov 10 14:57:08 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:57:08 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:57:08 user nova-compute[75703]:     </rng>
Nov 10 14:57:08 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:57:08 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:57:08 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:57:08 user nova-compute[75703]:     </memballoon>
Nov 10 14:57:08 user nova-compute[75703]:   </devices>
Nov 10 14:57:08 user nova-compute[75703]: </domain>
Nov 10 14:57:08 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-83423106',display_name='tempest-ServersNegativeTestJSON-server-83423106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-83423106',id=30,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482ca92ae18d432da1805be8bcdb88dd',ramdisk_id='',reservation_id='r-l6j7q0aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2142185333',owner_user_name='tempest-ServersNegativeTestJSON-2142185333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:57:06Z,user_data=None,user_id='9806be7af5fd410d971f2384899eab85',uuid=92d1fcb9-de3a-4b51-97bb-81ce39e8dd27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converting VIF {"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG os_vif [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e12b3d6-68a8-5344-a968-64b3a7d0a0ed', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f2fc4f-08, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7f2fc4f-08, col_values=(('qos', UUID('66864d2a-d788-4e0a-97b4-bf5992c4dbcc')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7f2fc4f-08, col_values=(('external_ids', {'iface-id': 'e7f2fc4f-086b-43a4-9f63-307b86e67417', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:d0:80', 'vm-uuid': '92d1fcb9-de3a-4b51-97bb-81ce39e8dd27'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:08 user nova-compute[75703]: INFO os_vif [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08')
Nov 10 14:57:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:57:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:57:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:57:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] No VIF found with MAC fa:16:3e:3c:d0:80, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:57:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:57:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:57:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7366MB free_disk=24.918781280517578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:57:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 5224b8c5-414d-41d5-b973-71474c10a5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance adf2c465-ae08-4bc1-a3f4-ef2b6f830552 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Updated VIF entry in instance network info cache for port e7f2fc4f-086b-43a4-9f63-307b86e67417. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Updating instance_info_cache with network_info: [{"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0efe0600-696a-4e5b-b3c1-0cfba37d95fb req-38728217-6cd8-47e7-949c-b8d4dd0f8f9a service nova] Releasing lock "refresh_cache-92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:10 user nova-compute[75703]: INFO nova.compute.manager [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Terminating instance
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-30728634-1fd1-4a7f-800c-8b1c52ea13e5 req-b84a716b-c30f-49b6-a6a8-c66dec59e5a1 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-vif-unplugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-30728634-1fd1-4a7f-800c-8b1c52ea13e5 req-b84a716b-c30f-49b6-a6a8-c66dec59e5a1 service nova] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-30728634-1fd1-4a7f-800c-8b1c52ea13e5 req-b84a716b-c30f-49b6-a6a8-c66dec59e5a1 service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-30728634-1fd1-4a7f-800c-8b1c52ea13e5 req-b84a716b-c30f-49b6-a6a8-c66dec59e5a1 service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-30728634-1fd1-4a7f-800c-8b1c52ea13e5 req-b84a716b-c30f-49b6-a6a8-c66dec59e5a1 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] No waiting events found dispatching network-vif-unplugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-30728634-1fd1-4a7f-800c-8b1c52ea13e5 req-b84a716b-c30f-49b6-a6a8-c66dec59e5a1 service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-vif-unplugged-1c43802c-661b-4562-affe-83d945c2cddf for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.978s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-b43d55c8-5c09-460c-b1da-14123317e150 req-26074d07-4c5c-4531-9673-ec6a90f7b8de service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b43d55c8-5c09-460c-b1da-14123317e150 req-26074d07-4c5c-4531-9673-ec6a90f7b8de service nova] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b43d55c8-5c09-460c-b1da-14123317e150 req-26074d07-4c5c-4531-9673-ec6a90f7b8de service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b43d55c8-5c09-460c-b1da-14123317e150 req-26074d07-4c5c-4531-9673-ec6a90f7b8de service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-b43d55c8-5c09-460c-b1da-14123317e150 req-26074d07-4c5c-4531-9673-ec6a90f7b8de service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] No waiting events found dispatching network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:10 user nova-compute[75703]: WARNING nova.compute.manager [req-b43d55c8-5c09-460c-b1da-14123317e150 req-26074d07-4c5c-4531-9673-ec6a90f7b8de service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received unexpected event network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 for instance with vm_state building and task_state spawning.
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Instance destroyed successfully.
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG nova.objects.instance [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'resources' on Instance uuid 5224b8c5-414d-41d5-b973-71474c10a5d0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-85769623',display_name='tempest-AttachVolumeTestJSON-server-85769623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-85769623',id=22,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeBeaPogfuFO2b73ltuJcALe7nBAq/0FBNMwRzjLn+/CzLssv3lvhQ+cFxzViJAmp2p0ZAqV2WXA2MuWcpVMk9TT0WAvs5PLxOOAYyWmRL+8VykP/9w72kh9A9xfLfhUw==',key_name='tempest-keypair-488592293',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:51:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d17d344f86f40bcbb293bcb8dc06fb3',ramdisk_id='',reservation_id='r-zzmr0kqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1704980195',owner_user_name='tempest-AttachVolumeTestJSON-1704980195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12a92500f85a405fabde541ca2f18a05',uuid=5224b8c5-414d-41d5-b973-71474c10a5d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converting VIF {"id": "1c43802c-661b-4562-affe-83d945c2cddf", "address": "fa:16:3e:95:82:c4", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c43802c-66", "ovs_interfaceid": "1c43802c-661b-4562-affe-83d945c2cddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG os_vif [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c43802c-66, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ab39a1-378a-4d09-bfac-b02beb6da4f9) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:57:11 user nova-compute[75703]: INFO os_vif [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:82:c4,bridge_name='br-int',has_traffic_filtering=True,id=1c43802c-661b-4562-affe-83d945c2cddf,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c43802c-66')
Nov 10 14:57:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Deleting instance files /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0_del
Nov 10 14:57:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Deletion of /opt/stack/data/nova/instances/5224b8c5-414d-41d5-b973-71474c10a5d0_del complete
Nov 10 14:57:11 user nova-compute[75703]: INFO nova.compute.manager [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 10 14:57:11 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:57:11 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:12 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Took 0.85 seconds to deallocate network for instance.
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-c327b085-996d-4755-8b9d-07d267a999e5 req-04ce2db9-08ec-4a8b-b7bf-fc5d373b3cad service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c327b085-996d-4755-8b9d-07d267a999e5 req-04ce2db9-08ec-4a8b-b7bf-fc5d373b3cad service nova] Acquiring lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c327b085-996d-4755-8b9d-07d267a999e5 req-04ce2db9-08ec-4a8b-b7bf-fc5d373b3cad service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c327b085-996d-4755-8b9d-07d267a999e5 req-04ce2db9-08ec-4a8b-b7bf-fc5d373b3cad service nova] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-c327b085-996d-4755-8b9d-07d267a999e5 req-04ce2db9-08ec-4a8b-b7bf-fc5d373b3cad service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] No waiting events found dispatching network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:12 user nova-compute[75703]: WARNING nova.compute.manager [req-c327b085-996d-4755-8b9d-07d267a999e5 req-04ce2db9-08ec-4a8b-b7bf-fc5d373b3cad service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received unexpected event network-vif-plugged-1c43802c-661b-4562-affe-83d945c2cddf for instance with vm_state deleted and task_state None.
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] No waiting events found dispatching network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:12 user nova-compute[75703]: WARNING nova.compute.manager [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received unexpected event network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 for instance with vm_state building and task_state spawning.
Nov 10 14:57:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-48a21ef0-d78b-48e5-8cea-a2f5ec94038f req-7d0b1d93-f8b0-4eb7-9cc0-b657914a904b service nova] [instance: 5224b8c5-414d-41d5-b973-71474c10a5d0] Received event network-vif-deleted-1c43802c-661b-4562-affe-83d945c2cddf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:13 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Deleted allocations for instance 5224b8c5-414d-41d5-b973-71474c10a5d0
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b6a8e428-7dcd-47c5-a8ad-9658d1080ee7 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "5224b8c5-414d-41d5-b973-71474c10a5d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:57:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Instance spawned successfully.
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:13 user nova-compute[75703]: INFO nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 10 14:57:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:57:13 user nova-compute[75703]: INFO nova.compute.manager [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Took 8.49 seconds to build instance.
Nov 10 14:57:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9e282217-21f6-487b-aade-97ffb962fa36 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.692s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:18 user nova-compute[75703]: INFO nova.compute.manager [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Unrescuing
Nov 10 14:57:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG nova.objects.instance [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'flavor' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-e8feeacf-2fa0-4928-b72c-a627df2f08c6 req-98309fcf-7f61-4aa7-ad7c-b64e6afc6952 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e8feeacf-2fa0-4928-b72c-a627df2f08c6 req-98309fcf-7f61-4aa7-ad7c-b64e6afc6952 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e8feeacf-2fa0-4928-b72c-a627df2f08c6 req-98309fcf-7f61-4aa7-ad7c-b64e6afc6952 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e8feeacf-2fa0-4928-b72c-a627df2f08c6 req-98309fcf-7f61-4aa7-ad7c-b64e6afc6952 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-e8feeacf-2fa0-4928-b72c-a627df2f08c6 req-98309fcf-7f61-4aa7-ad7c-b64e6afc6952 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:19 user nova-compute[75703]: WARNING nova.compute.manager [req-e8feeacf-2fa0-4928-b72c-a627df2f08c6 req-98309fcf-7f61-4aa7-ad7c-b64e6afc6952 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:57:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:19 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance destroyed successfully.
Nov 10 14:57:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-0706ba8b-3f75-43bf-9222-1e1527dca118 req-801afe54-9de4-4210-9f95-46f25eb2041d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0706ba8b-3f75-43bf-9222-1e1527dca118 req-801afe54-9de4-4210-9f95-46f25eb2041d service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0706ba8b-3f75-43bf-9222-1e1527dca118 req-801afe54-9de4-4210-9f95-46f25eb2041d service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0706ba8b-3f75-43bf-9222-1e1527dca118 req-801afe54-9de4-4210-9f95-46f25eb2041d service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-0706ba8b-3f75-43bf-9222-1e1527dca118 req-801afe54-9de4-4210-9f95-46f25eb2041d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:21 user nova-compute[75703]: WARNING nova.compute.manager [req-0706ba8b-3f75-43bf-9222-1e1527dca118 req-801afe54-9de4-4210-9f95-46f25eb2041d service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:57:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:23 user nova-compute[75703]: WARNING nova.compute.manager [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:57:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:57:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:57:23 user nova-compute[75703]: WARNING nova.compute.manager [req-1ca981fc-2bb8-4bfd-8c6e-ab5ba27fb962 req-f603461b-eb8a-4a41-8808-c1e282d246f8 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state rescued and task_state unrescuing.
Nov 10 14:57:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-619ed0e5-9d94-4750-9fe6-2a58f403d99f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:57:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-changed-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing instance network info cache due to event network-changed-66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updated VIF entry in instance network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0cf22dfa-dba3-4f62-978c-fde273baf93c req-41ee3e24-4ab5-48d2-8a08-f79e1df116c9 service nova] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-changed-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing instance network info cache due to event network-changed-66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] Acquiring lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] Acquired lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Refreshing network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:57:38 user nova-compute[75703]: INFO nova.compute.manager [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Detaching volume e2698b12-9352-4739-994b-05d4c4535ce9
Nov 10 14:57:38 user nova-compute[75703]: INFO nova.virt.block_device [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Attempting to driver detach volume e2698b12-9352-4739-994b-05d4c4535ce9 from mountpoint /dev/vdb
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Attempting to detach device vdb from instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:57:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:57:38 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:57:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:57:38 user nova-compute[75703]:   <serial>e2698b12-9352-4739-994b-05d4c4535ce9</serial>
Nov 10 14:57:38 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 14:57:38 user nova-compute[75703]: </disk>
Nov 10 14:57:38 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:57:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully detached device vdb from instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 from the persistent domain config.
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 14:57:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:57:38 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 14:57:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 14:57:38 user nova-compute[75703]:   <serial>e2698b12-9352-4739-994b-05d4c4535ce9</serial>
Nov 10 14:57:38 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 14:57:38 user nova-compute[75703]: </disk>
Nov 10 14:57:38 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updated VIF entry in instance network info cache for port 66335289-4294-4845-9d74-0111f74eb8f2. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [{"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:57:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4cd0f80a-70d8-45de-b5e5-36a9d7959b2f req-cfc3b673-6edc-485a-9cef-50317e0f1576 service nova] Releasing lock "refresh_cache-0870c08a-f3dc-4299-aa98-b509d3cea1e8" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:57:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 14:57:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:57:59 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 is timed out.
Nov 10 14:57:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully detached device vdb from instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 from the live domain config.
Nov 10 14:57:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvEVLMhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:57:59 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e5ca00-cf4c-4893-adf4-af5aaba7162b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:57:59 user nova-compute[75703]: No targets found.
Nov 10 14:57:59 user nova-compute[75703]: iSNS:
Nov 10 14:57:59 user nova-compute[75703]: No targets found.
Nov 10 14:57:59 user nova-compute[75703]: STATIC:
Nov 10 14:57:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 14:57:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:57:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:57:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683
Nov 10 14:57:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:57:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:57:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9
Nov 10 14:57:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:57:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:57:59 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:57:59 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:57:59 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:57:59 user nova-compute[75703]: FIRMWARE:
Nov 10 14:57:59 user nova-compute[75703]: No targets found.
Nov 10 14:57:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:57:59 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:57:59 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1696ef5-1e82-4bcb-8351-44cea5dfd751]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2c6c4-74af-45fe-8b58-0853dbf6d3f3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:57:59 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:57:59 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:57:59 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:57:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:57:59 user nova-compute[75703]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 (non-flash)
Nov 10 14:57:59 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:57:59 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:57:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43eab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc1db8d-77d8-4a7b-828a-86c3f8bf26cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc50225d-1d2a-4e55-b1fd-a0253bddd49d]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f44b6-9947-4696-90bb-0c477e9d290f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42fcb4-b6d9-4a4c-bf78-239c4071b5a2]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[98399996-9aec-42e8-8f9f-8855fcbfe71e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc20dfb-d341-49e7-9551-b91ad2f3fbc4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260]
Nov 10 14:57:59 user nova-compute[75703]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9, portal: 172.16.0.220,3260] successful.
Nov 10 14:57:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2698b12-9352-4739-994b-05d4c4535ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e8af72-ff28-49b1-9248-fdc464096dec]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== disconnect_volume: return (316ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:57:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:58:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:00 user nova-compute[75703]: DEBUG nova.objects.instance [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'flavor' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-18f3c159-78c5-4db2-8f01-38e5fd2149f1 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.993s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:04 user nova-compute[75703]: INFO nova.compute.manager [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Terminating instance
Nov 10 14:58:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-87fce3d6-b4ff-44f4-a8fb-1928a0ce2c5d req-b0f1a37c-4ee0-4998-a76d-e3e65f673aa8 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-vif-unplugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-87fce3d6-b4ff-44f4-a8fb-1928a0ce2c5d req-b0f1a37c-4ee0-4998-a76d-e3e65f673aa8 service nova] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-87fce3d6-b4ff-44f4-a8fb-1928a0ce2c5d req-b0f1a37c-4ee0-4998-a76d-e3e65f673aa8 service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-87fce3d6-b4ff-44f4-a8fb-1928a0ce2c5d req-b0f1a37c-4ee0-4998-a76d-e3e65f673aa8 service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-87fce3d6-b4ff-44f4-a8fb-1928a0ce2c5d req-b0f1a37c-4ee0-4998-a76d-e3e65f673aa8 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] No waiting events found dispatching network-vif-unplugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-87fce3d6-b4ff-44f4-a8fb-1928a0ce2c5d req-b0f1a37c-4ee0-4998-a76d-e3e65f673aa8 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-vif-unplugged-0eac2a8e-edca-4788-848e-d50b69876ffc for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:58:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Instance destroyed successfully.
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'resources' on Instance uuid adf2c465-ae08-4bc1-a3f4-ef2b6f830552 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-801514877',display_name='tempest-TestVolumeBootPattern-server-801514877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-801514877',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-ev0t6bi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:56:18Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=adf2c465-ae08-4bc1-a3f4-ef2b6f830552,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "0eac2a8e-edca-4788-848e-d50b69876ffc", "address": "fa:16:3e:04:95:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eac2a8e-ed", "ovs_interfaceid": "0eac2a8e-edca-4788-848e-d50b69876ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_vif [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0eac2a8e-ed, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65883ce6-cfde-4edf-9d18-1c1a28f62fc7) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:05 user nova-compute[75703]: INFO os_vif [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:95:08,bridge_name='br-int',has_traffic_filtering=True,id=0eac2a8e-edca-4788-848e-d50b69876ffc,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eac2a8e-ed')
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVIkUGiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:58:05 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd054a6-8be9-4e96-adaa-a489bfdd2d74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 14:58:05 user nova-compute[75703]: No targets found.
Nov 10 14:58:05 user nova-compute[75703]: iSNS:
Nov 10 14:58:05 user nova-compute[75703]: No targets found.
Nov 10 14:58:05 user nova-compute[75703]: STATIC:
Nov 10 14:58:05 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 14:58:05 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:58:05 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:58:05 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683
Nov 10 14:58:05 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:58:05 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:58:05 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 14:58:05 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 14:58:05 user nova-compute[75703]:                 Iface Name: default
Nov 10 14:58:05 user nova-compute[75703]: FIRMWARE:
Nov 10 14:58:05 user nova-compute[75703]: No targets found.
Nov 10 14:58:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 14:58:05 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 14:58:05 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae5f34e-eb4f-49ea-8c15-278ea46efff8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7aeb3-8f4e-4f63-8e1c-e26a26f18eeb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:58:05 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:58:05 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:58:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:58:05 user nova-compute[75703]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 (non-flash)
Nov 10 14:58:05 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:58:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43e9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c3b1f1-c2e4-489f-838f-8e9ab70b99df]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.044s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209384a-4662-4109-ad47-aa18c1ca3608]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe48275-a722-4693-879d-8cf5fa758635]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[56734652-06d4-4c07-a99d-18fe0311c99a]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:58:05 user nova-compute[75703]: INFO nova.compute.claims [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Claim successful on node user
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b92255-e56f-44e8-a7f3-1eaa9537b91b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19771eda-440a-44ec-8cf6-a048b50da670]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260]
Nov 10 14:58:05 user nova-compute[75703]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683, portal: 172.16.0.220,3260] successful.
Nov 10 14:58:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b157c2e-131f-4143-be55-eca198f80683 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb40cd-8089-4613-8e79-8c63d66a11b1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== disconnect_volume: return (474ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 14:58:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Deleting instance files /opt/stack/data/nova/instances/adf2c465-ae08-4bc1-a3f4-ef2b6f830552_del
Nov 10 14:58:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Deletion of /opt/stack/data/nova/instances/adf2c465-ae08-4bc1-a3f4-ef2b6f830552_del complete
Nov 10 14:58:05 user nova-compute[75703]: INFO nova.compute.manager [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 10 14:58:05 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:58:05 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:58:06 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Took 0.57 seconds to deallocate network for instance.
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-f476ed68-b135-478a-af46-d2b0fbe5fec7 req-8925215b-49f9-4b3a-b06b-aca9f551f2f9 service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-vif-deleted-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.893s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:58:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.policy [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12a92500f85a405fabde541ca2f18a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d17d344f86f40bcbb293bcb8dc06fb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:58:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Creating image(s)
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "/opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "/opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "/opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-6f793579-1851-475c-827c-4b4ed84e54f9 req-03111303-ac66-4b6d-978b-d7bbfad7480f service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received event network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6f793579-1851-475c-827c-4b4ed84e54f9 req-03111303-ac66-4b6d-978b-d7bbfad7480f service nova] Acquiring lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6f793579-1851-475c-827c-4b4ed84e54f9 req-03111303-ac66-4b6d-978b-d7bbfad7480f service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6f793579-1851-475c-827c-4b4ed84e54f9 req-03111303-ac66-4b6d-978b-d7bbfad7480f service nova] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-6f793579-1851-475c-827c-4b4ed84e54f9 req-03111303-ac66-4b6d-978b-d7bbfad7480f service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] No waiting events found dispatching network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:06 user nova-compute[75703]: WARNING nova.compute.manager [req-6f793579-1851-475c-827c-4b4ed84e54f9 req-03111303-ac66-4b6d-978b-d7bbfad7480f service nova] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Received unexpected event network-vif-plugged-0eac2a8e-edca-4788-848e-d50b69876ffc for instance with vm_state active and task_state deleting.
Nov 10 14:58:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk 1073741824" returned: 0 in 0.054s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: INFO nova.compute.manager [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Took 1.14 seconds to detach 1 volumes for instance.
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Successfully created port: 2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: adf2c465-ae08-4bc1-a3f4-ef2b6f830552] Deleting volume: 3b157c2e-131f-4143-be55-eca198f80683 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Cannot resize image /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Ensure instance console log exists: /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:58:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Successfully updated port: 2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquired lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-changed-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Refreshing instance network info cache due to event network-changed-2c05ad70-1d8d-43d9-a952-7d58ca951a8b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] Acquiring lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.009s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:08 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Deleted allocations for instance adf2c465-ae08-4bc1-a3f4-ef2b6f830552
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8f1109ec-cb1a-4a5b-82de-7ce17b0fb29a tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "adf2c465-ae08-4bc1-a3f4-ef2b6f830552" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.530s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updating instance_info_cache with network_info: [{"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Releasing lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Instance network_info: |[{"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] Acquired lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Refreshing network info cache for port 2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Start _get_guest_xml network_info=[{"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:58:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:58:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823796245',display_name='tempest-AttachVolumeTestJSON-server-1823796245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823796245',id=31,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxLdSPkLxPdE7Ox0glF5vdNe/5mGyRQV4Ha0XO+dGnCFE+KuVGFF2jkAP7gR4w7RF+Pw3LjVU/8U+6SGf4zdz5S+Aa0HHFlOrPGLLi1ua1GZNMz7f9JlW2oruOfbOT5xg==',key_name='tempest-keypair-1965700923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d17d344f86f40bcbb293bcb8dc06fb3',ramdisk_id='',reservation_id='r-zarqai03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1704980195',owner_user_name='tempest-AttachVolumeTestJSON-1704980195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12a92500f85a405fabde541ca2f18a05',uuid=36a3590e-c24d-459e-8a32-6f13a4e10498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converting VIF {"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'pci_devices' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:58:09 user nova-compute[75703]:   <uuid>36a3590e-c24d-459e-8a32-6f13a4e10498</uuid>
Nov 10 14:58:09 user nova-compute[75703]:   <name>instance-0000001f</name>
Nov 10 14:58:09 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:58:09 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:58:09 user nova-compute[75703]:   <metadata>
Nov 10 14:58:09 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:58:09 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:58:09 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeTestJSON-server-1823796245</nova:name>
Nov 10 14:58:09 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:58:09</nova:creationTime>
Nov 10 14:58:09 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:58:09 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:58:09 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:58:09 user nova-compute[75703]:       <nova:owner>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:user uuid="12a92500f85a405fabde541ca2f18a05">tempest-AttachVolumeTestJSON-1704980195-project-member</nova:user>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:project uuid="1d17d344f86f40bcbb293bcb8dc06fb3">tempest-AttachVolumeTestJSON-1704980195</nova:project>
Nov 10 14:58:09 user nova-compute[75703]:       </nova:owner>
Nov 10 14:58:09 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:58:09 user nova-compute[75703]:       <nova:ports>
Nov 10 14:58:09 user nova-compute[75703]:         <nova:port uuid="2c05ad70-1d8d-43d9-a952-7d58ca951a8b">
Nov 10 14:58:09 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 14:58:09 user nova-compute[75703]:         </nova:port>
Nov 10 14:58:09 user nova-compute[75703]:       </nova:ports>
Nov 10 14:58:09 user nova-compute[75703]:     </nova:instance>
Nov 10 14:58:09 user nova-compute[75703]:   </metadata>
Nov 10 14:58:09 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:58:09 user nova-compute[75703]:     <system>
Nov 10 14:58:09 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:58:09 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:58:09 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:58:09 user nova-compute[75703]:       <entry name="serial">36a3590e-c24d-459e-8a32-6f13a4e10498</entry>
Nov 10 14:58:09 user nova-compute[75703]:       <entry name="uuid">36a3590e-c24d-459e-8a32-6f13a4e10498</entry>
Nov 10 14:58:09 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:58:09 user nova-compute[75703]:     </system>
Nov 10 14:58:09 user nova-compute[75703]:   </sysinfo>
Nov 10 14:58:09 user nova-compute[75703]:   <os>
Nov 10 14:58:09 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:58:09 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:58:09 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:58:09 user nova-compute[75703]:   </os>
Nov 10 14:58:09 user nova-compute[75703]:   <features>
Nov 10 14:58:09 user nova-compute[75703]:     <acpi/>
Nov 10 14:58:09 user nova-compute[75703]:     <apic/>
Nov 10 14:58:09 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:58:09 user nova-compute[75703]:   </features>
Nov 10 14:58:09 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:58:09 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:58:09 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:58:09 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:58:09 user nova-compute[75703]:   </clock>
Nov 10 14:58:09 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:58:09 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:58:09 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:58:09 user nova-compute[75703]:   </cpu>
Nov 10 14:58:09 user nova-compute[75703]:   <devices>
Nov 10 14:58:09 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:58:09 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:58:09 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk"/>
Nov 10 14:58:09 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:58:09 user nova-compute[75703]:     </disk>
Nov 10 14:58:09 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:58:09 user nova-compute[75703]:       <mac address="fa:16:3e:73:77:e2"/>
Nov 10 14:58:09 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:58:09 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:58:09 user nova-compute[75703]:       <target dev="tap2c05ad70-1d"/>
Nov 10 14:58:09 user nova-compute[75703]:     </interface>
Nov 10 14:58:09 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:58:09 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/console.log" append="off"/>
Nov 10 14:58:09 user nova-compute[75703]:     </serial>
Nov 10 14:58:09 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:58:09 user nova-compute[75703]:     <video>
Nov 10 14:58:09 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:58:09 user nova-compute[75703]:     </video>
Nov 10 14:58:09 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:58:09 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:58:09 user nova-compute[75703]:     </rng>
Nov 10 14:58:09 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:58:09 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:58:09 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:58:09 user nova-compute[75703]:     </memballoon>
Nov 10 14:58:09 user nova-compute[75703]:   </devices>
Nov 10 14:58:09 user nova-compute[75703]: </domain>
Nov 10 14:58:09 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823796245',display_name='tempest-AttachVolumeTestJSON-server-1823796245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823796245',id=31,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxLdSPkLxPdE7Ox0glF5vdNe/5mGyRQV4Ha0XO+dGnCFE+KuVGFF2jkAP7gR4w7RF+Pw3LjVU/8U+6SGf4zdz5S+Aa0HHFlOrPGLLi1ua1GZNMz7f9JlW2oruOfbOT5xg==',key_name='tempest-keypair-1965700923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d17d344f86f40bcbb293bcb8dc06fb3',ramdisk_id='',reservation_id='r-zarqai03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1704980195',owner_user_name='tempest-AttachVolumeTestJSON-1704980195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12a92500f85a405fabde541ca2f18a05',uuid=36a3590e-c24d-459e-8a32-6f13a4e10498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converting VIF {"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG os_vif [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06d5046c-a77f-51a6-a834-fb42abc674c5', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c05ad70-1d, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c05ad70-1d, col_values=(('qos', UUID('873bcfe1-b4f7-459f-96ba-7d77d6dc3cf1')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c05ad70-1d, col_values=(('external_ids', {'iface-id': '2c05ad70-1d8d-43d9-a952-7d58ca951a8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:77:e2', 'vm-uuid': '36a3590e-c24d-459e-8a32-6f13a4e10498'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:09 user nova-compute[75703]: INFO os_vif [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d')
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No VIF found with MAC fa:16:3e:73:77:e2, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:58:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'adf2c465-ae08-4bc1-a3f4-ef2b6f830552' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'adf2c465-ae08-4bc1-a3f4-ef2b6f830552' (instance-0000001c)
Nov 10 14:58:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updated VIF entry in instance network info cache for port 2c05ad70-1d8d-43d9-a952-7d58ca951a8b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updating instance_info_cache with network_info: [{"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-fadc8f93-21f5-4522-9e03-0edf2c01fd1d req-869224a7-5dd9-4deb-9dcf-3fb2dfb22d07 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fadc8f93-21f5-4522-9e03-0edf2c01fd1d req-869224a7-5dd9-4deb-9dcf-3fb2dfb22d07 service nova] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fadc8f93-21f5-4522-9e03-0edf2c01fd1d req-869224a7-5dd9-4deb-9dcf-3fb2dfb22d07 service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fadc8f93-21f5-4522-9e03-0edf2c01fd1d req-869224a7-5dd9-4deb-9dcf-3fb2dfb22d07 service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-fadc8f93-21f5-4522-9e03-0edf2c01fd1d req-869224a7-5dd9-4deb-9dcf-3fb2dfb22d07 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] No waiting events found dispatching network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:13 user nova-compute[75703]: WARNING nova.compute.manager [req-fadc8f93-21f5-4522-9e03-0edf2c01fd1d req-869224a7-5dd9-4deb-9dcf-3fb2dfb22d07 service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received unexpected event network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b for instance with vm_state building and task_state spawning.
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-39873228-e17b-40e3-8fc7-f582348accf7 req-66df0627-cc46-4633-ba64-a583884a4b6d service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-39873228-e17b-40e3-8fc7-f582348accf7 req-66df0627-cc46-4633-ba64-a583884a4b6d service nova] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-39873228-e17b-40e3-8fc7-f582348accf7 req-66df0627-cc46-4633-ba64-a583884a4b6d service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-39873228-e17b-40e3-8fc7-f582348accf7 req-66df0627-cc46-4633-ba64-a583884a4b6d service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-39873228-e17b-40e3-8fc7-f582348accf7 req-66df0627-cc46-4633-ba64-a583884a4b6d service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] No waiting events found dispatching network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:13 user nova-compute[75703]: WARNING nova.compute.manager [req-39873228-e17b-40e3-8fc7-f582348accf7 req-66df0627-cc46-4633-ba64-a583884a4b6d service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received unexpected event network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b for instance with vm_state building and task_state spawning.
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d64a211c-75b3-4b19-b43b-711cafb41509 req-f2bcbb51-623a-42c6-a71f-192ad9c495e0 service nova] Releasing lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:58:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:58:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7318MB free_disk=24.911392211914062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Instance spawned successfully.
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:58:13 user nova-compute[75703]: INFO nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:58:13 user nova-compute[75703]: INFO nova.compute.manager [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Took 8.19 seconds to build instance.
Nov 10 14:58:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f10362a9-f5a6-4b74-9570-201f887594da tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.357s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 36a3590e-c24d-459e-8a32-6f13a4e10498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:58:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.039s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 2 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 14:58:14 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deletion of /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize failed
Nov 10 14:58:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 14:58:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:58:15 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updating instance_info_cache with network_info: [{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:41 user nova-compute[75703]: INFO nova.compute.manager [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Terminating instance
Nov 10 14:58:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-040731b6-c4b0-4f17-a4fd-5623dd18d8b5 req-9959e0e4-f69b-44f1-8c71-7c7695257952 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-unplugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-040731b6-c4b0-4f17-a4fd-5623dd18d8b5 req-9959e0e4-f69b-44f1-8c71-7c7695257952 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-040731b6-c4b0-4f17-a4fd-5623dd18d8b5 req-9959e0e4-f69b-44f1-8c71-7c7695257952 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-040731b6-c4b0-4f17-a4fd-5623dd18d8b5 req-9959e0e4-f69b-44f1-8c71-7c7695257952 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-040731b6-c4b0-4f17-a4fd-5623dd18d8b5 req-9959e0e4-f69b-44f1-8c71-7c7695257952 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-unplugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-040731b6-c4b0-4f17-a4fd-5623dd18d8b5 req-9959e0e4-f69b-44f1-8c71-7c7695257952 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-unplugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:58:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Instance destroyed successfully.
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'resources' on Instance uuid 0870c08a-f3dc-4299-aa98-b509d3cea1e8 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-754884787',display_name='tempest-TestMinimumBasicScenario-server-754884787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-754884787',id=26,image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCoLe9RFklcjNxsU1qMot0dyDlwkLe2Rugi+GRQW5T7to0FacTYosg0vCSAi82F3yNDq7XI/pSwICc5y/1Kcb/cUnCv8wt8ymoD7EvlN2E6eKZfhsv20mvUzLAjHdI01Q==',key_name='tempest-TestMinimumBasicScenario-543665677',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-d90rcwao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f634226-1552-4731-bfa4-dbb7e36bc0be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:55:53Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=0870c08a-f3dc-4299-aa98-b509d3cea1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "66335289-4294-4845-9d74-0111f74eb8f2", "address": "fa:16:3e:dc:3b:b9", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66335289-42", "ovs_interfaceid": "66335289-4294-4845-9d74-0111f74eb8f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG os_vif [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66335289-42, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d609d543-2483-4cd8-a1ab-8e8955afde76) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:58:42 user nova-compute[75703]: INFO os_vif [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3b:b9,bridge_name='br-int',has_traffic_filtering=True,id=66335289-4294-4845-9d74-0111f74eb8f2,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66335289-42')
Nov 10 14:58:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Deleting instance files /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8_del
Nov 10 14:58:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Deletion of /opt/stack/data/nova/instances/0870c08a-f3dc-4299-aa98-b509d3cea1e8_del complete
Nov 10 14:58:42 user nova-compute[75703]: INFO nova.compute.manager [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 14:58:42 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:58:42 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:58:43 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:43 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Took 0.60 seconds to deallocate network for instance.
Nov 10 14:58:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:43 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:58:43 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:58:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:43 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Deleted allocations for instance 0870c08a-f3dc-4299-aa98-b509d3cea1e8
Nov 10 14:58:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a8ef79d3-2021-411d-afbf-aa6632925423 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] Acquiring lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] Lock "0870c08a-f3dc-4299-aa98-b509d3cea1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] No waiting events found dispatching network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:44 user nova-compute[75703]: WARNING nova.compute.manager [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received unexpected event network-vif-plugged-66335289-4294-4845-9d74-0111f74eb8f2 for instance with vm_state deleted and task_state None.
Nov 10 14:58:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-48cc7681-fdc6-49cf-b776-5528930f5f06 req-50aa0d24-d4c4-4f0a-8bd6-ed654f5ba830 service nova] [instance: 0870c08a-f3dc-4299-aa98-b509d3cea1e8] Received event network-vif-deleted-66335289-4294-4845-9d74-0111f74eb8f2 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:47 user nova-compute[75703]: INFO nova.compute.manager [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Rescuing
Nov 10 14:58:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG nova.network.neutron [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG nova.network.neutron [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updating instance_info_cache with network_info: [{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-15c30f0e-991d-4276-982c-f5f6e5ed64af req-c2f35e9f-2740-40cd-aecf-a2f648329310 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15c30f0e-991d-4276-982c-f5f6e5ed64af req-c2f35e9f-2740-40cd-aecf-a2f648329310 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15c30f0e-991d-4276-982c-f5f6e5ed64af req-c2f35e9f-2740-40cd-aecf-a2f648329310 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-15c30f0e-991d-4276-982c-f5f6e5ed64af req-c2f35e9f-2740-40cd-aecf-a2f648329310 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-15c30f0e-991d-4276-982c-f5f6e5ed64af req-c2f35e9f-2740-40cd-aecf-a2f648329310 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:47 user nova-compute[75703]: WARNING nova.compute.manager [req-15c30f0e-991d-4276-982c-f5f6e5ed64af req-c2f35e9f-2740-40cd-aecf-a2f648329310 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state active and task_state rescuing.
Nov 10 14:58:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance destroyed successfully.
Nov 10 14:58:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Attempting a stable device rescue
Nov 10 14:58:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75703) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 14:58:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Creating image(s)
Nov 10 14:58:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "/opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG nova.objects.instance [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.part --force-share --output=json" returned: 0 in 0.215s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:49 user nova-compute[75703]: DEBUG nova.virt.images [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] d00004bd-6c14-4e3d-bc07-5f588da7f655 was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:58:49 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:58:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.part /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-f403e852-048c-411f-994c-fe0f6f291bdc req-e7feaa26-0b6a-41c2-97a8-987da7d18373 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f403e852-048c-411f-994c-fe0f6f291bdc req-e7feaa26-0b6a-41c2-97a8-987da7d18373 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f403e852-048c-411f-994c-fe0f6f291bdc req-e7feaa26-0b6a-41c2-97a8-987da7d18373 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f403e852-048c-411f-994c-fe0f6f291bdc req-e7feaa26-0b6a-41c2-97a8-987da7d18373 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-f403e852-048c-411f-994c-fe0f6f291bdc req-e7feaa26-0b6a-41c2-97a8-987da7d18373 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:50 user nova-compute[75703]: WARNING nova.compute.manager [req-f403e852-048c-411f-994c-fe0f6f291bdc req-e7feaa26-0b6a-41c2-97a8-987da7d18373 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state active and task_state rescuing.
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.part /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.converted" returned: 0 in 0.802s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.293s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5 --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5,backing_fmt=raw /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5,backing_fmt=raw /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue" returned: 0 in 0.054s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'migration_context' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<e1842482-4120-40ff-843d-6395f6b14960> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Start _get_guest_xml network_info=[{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "vif_mac": "fa:16:3e:be:bc:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd00004bd-6c14-4e3d-bc07-5f588da7f655', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5efc89dd-d8f4-43f7-8a55-62b4bba637da', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e1842482-4120-40ff-843d-6395f6b14960', 'attached_at': '', 'detached_at': '', 'volume_id': '62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'serial': '62b52bf0-2fab-418c-b846-8e9ddf1e58b9'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'resources' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<e1842482-4120-40ff-843d-6395f6b14960> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'numa_topology' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<e1842482-4120-40ff-843d-6395f6b14960> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:58:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:58:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<e1842482-4120-40ff-843d-6395f6b14960> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:58:51 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:58:51 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:58:51 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e126d99c-d98a-4fd5-a090-bb337829f534]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JZCcfmxR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 14:58:51 user nova-compute[75703]: node.name = iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 14:58:51 user nova-compute[75703]: node.tpgt = -1
Nov 10 14:58:51 user nova-compute[75703]: node.startup = automatic
Nov 10 14:58:51 user nova-compute[75703]: node.leading_login = No
Nov 10 14:58:51 user nova-compute[75703]: iface.iscsi_ifacename = default
Nov 10 14:58:51 user nova-compute[75703]: iface.net_ifacename = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.ipaddress = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.prefix_len = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.hwaddress = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.transport_name = tcp
Nov 10 14:58:51 user nova-compute[75703]: iface.initiatorname = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.vlan_id = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.vlan_priority = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.vlan_state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.iface_num = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.mtu = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.port = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.bootproto = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.subnet_mask = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.gateway = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_alt_client_id = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_dns = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_learn_iqn = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_vendor_id_state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_vendor_id = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.dhcp_slp_da = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.fragmentation = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.gratuitous_arp = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.incoming_forwarding = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.tos_state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.tos = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.ttl = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.delayed_ack = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.tcp_nagle = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.tcp_wsf_state = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.tcp_wsf = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.tcp_timer_scale = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.tcp_timestamp = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.redirect = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.def_task_mgmt_timeout = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.header_digest = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.data_digest = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.immediate_data = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.initial_r2t = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.data_seq_inorder = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.data_pdu_inorder = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.erl = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.max_receive_data_len = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.first_burst_len = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.max_outstanding_r2t = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.max_burst_len = 0
Nov 10 14:58:51 user nova-compute[75703]: iface.chap_auth = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.bidi_chap = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.strict_login_compliance = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.discovery_auth = <empty>
Nov 10 14:58:51 user nova-compute[75703]: iface.discovery_logout = <empty>
Nov 10 14:58:51 user nova-compute[75703]: node.discovery_address = <empty>
Nov 10 14:58:51 user nova-compute[75703]: node.discovery_port = 0
Nov 10 14:58:51 user nova-compute[75703]: node.discovery_type = static
Nov 10 14:58:51 user nova-compute[75703]: node.session.initial_cmdsn = 0
Nov 10 14:58:51 user nova-compute[75703]: node.session.initial_login_retry_max = 8
Nov 10 14:58:51 user nova-compute[75703]: node.session.xmit_thread_priority = -20
Nov 10 14:58:51 user nova-compute[75703]: node.session.cmds_max = 128
Nov 10 14:58:51 user nova-compute[75703]: node.session.queue_depth = 32
Nov 10 14:58:51 user nova-compute[75703]: node.session.nr_sessions = 1
Nov 10 14:58:51 user nova-compute[75703]: node.session.auth.authmethod = CHAP
Nov 10 14:58:51 user nova-compute[75703]: node.session.auth.username = JZCcfmxR
Nov 10 14:58:51 user nova-compute[75703]: node.session.auth.password = ***
Nov 10 14:58:51 user nova-compute[75703]: node.session.auth.username_in = <empty>
Nov 10 14:58:51 user nova-compute[75703]: node.session.auth.password_in = <empty>
Nov 10 14:58:51 user nova-compute[75703]: node.session.auth.chap_algs = MD5
Nov 10 14:58:51 user nova-compute[75703]: node.session.timeo.replacement_timeout = 120
Nov 10 14:58:51 user nova-compute[75703]: node.session.err_timeo.abort_timeout = 15
Nov 10 14:58:51 user nova-compute[75703]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 14:58:51 user nova-compute[75703]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 14:58:51 user nova-compute[75703]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.FastAbort = Yes
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.InitialR2T = No
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.ImmediateData = Yes
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.MaxConnections = 1
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 14:58:51 user nova-compute[75703]: node.session.iscsi.ERL = 0
Nov 10 14:58:51 user nova-compute[75703]: node.session.scan = manual
Nov 10 14:58:51 user nova-compute[75703]: node.session.reopen_max = 0
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].address = 172.16.0.220
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].port = 3260
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].startup = manual
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].tcp.window_size = 524288
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].tcp.type_of_service = 0
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].timeo.logout_timeout = 15
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].timeo.login_timeout = 15
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].timeo.auth_timeout = 45
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].iscsi.DataDigest = None
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].iscsi.IFMarker = No
Nov 10 14:58:51 user nova-compute[75703]: node.conn[0].iscsi.OFMarker = No
Nov 10 14:58:51 user nova-compute[75703]: # END RECORD
Nov 10 14:58:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d506c-ee01-4c28-9090-ca2abef50e0c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0e84a-0fd2-4099-827e-3f5098e97b7e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZCcfmxR {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZCcfmxR" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e196129-b842-4175-8862-41e7740e7bf6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JZCcfmxR'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a5b5f-3604-4946-a3ac-eb855a5ced26]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e97d6-a985-4017-9de8-d914166e2903]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:58:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:58:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:58:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:58:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[75949ca3-5822-463e-91c3-c9ab26c84e8c]: (4, ('0 0 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23362323264353033', 'path': '/dev/sdd'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362323264353033', 'path': '/dev/sdd'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71868614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71868614',id=29,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:57:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-8qu751zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:57:01Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=e1842482-4120-40ff-843d-6395f6b14960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "vif_mac": "fa:16:3e:be:bc:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "vif_mac": "fa:16:3e:be:bc:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'pci_devices' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.objects.base [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Object Instance<e1842482-4120-40ff-843d-6395f6b14960> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:58:51 user nova-compute[75703]:   <uuid>e1842482-4120-40ff-843d-6395f6b14960</uuid>
Nov 10 14:58:51 user nova-compute[75703]:   <name>instance-0000001d</name>
Nov 10 14:58:51 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:58:51 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:58:51 user nova-compute[75703]:   <metadata>
Nov 10 14:58:51 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:58:51 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:58:51 user nova-compute[75703]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-71868614</nova:name>
Nov 10 14:58:51 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:58:51</nova:creationTime>
Nov 10 14:58:51 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:58:51 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:58:51 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:58:51 user nova-compute[75703]:       <nova:owner>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:user uuid="90957e8164224a1285c067f0313178a2">tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member</nova:user>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:project uuid="6b19b6b93f7b4e6dbe0ded4d084792f2">tempest-ServerBootFromVolumeStableRescueTest-2023657370</nova:project>
Nov 10 14:58:51 user nova-compute[75703]:       </nova:owner>
Nov 10 14:58:51 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:58:51 user nova-compute[75703]:       <nova:ports>
Nov 10 14:58:51 user nova-compute[75703]:         <nova:port uuid="539018f0-1a3d-4d66-8953-2dfe71dbff34">
Nov 10 14:58:51 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:58:51 user nova-compute[75703]:         </nova:port>
Nov 10 14:58:51 user nova-compute[75703]:       </nova:ports>
Nov 10 14:58:51 user nova-compute[75703]:     </nova:instance>
Nov 10 14:58:51 user nova-compute[75703]:   </metadata>
Nov 10 14:58:51 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:58:51 user nova-compute[75703]:     <system>
Nov 10 14:58:51 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:58:51 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:58:51 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:58:51 user nova-compute[75703]:       <entry name="serial">e1842482-4120-40ff-843d-6395f6b14960</entry>
Nov 10 14:58:51 user nova-compute[75703]:       <entry name="uuid">e1842482-4120-40ff-843d-6395f6b14960</entry>
Nov 10 14:58:51 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:58:51 user nova-compute[75703]:     </system>
Nov 10 14:58:51 user nova-compute[75703]:   </sysinfo>
Nov 10 14:58:51 user nova-compute[75703]:   <os>
Nov 10 14:58:51 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:58:51 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:58:51 user nova-compute[75703]:   </os>
Nov 10 14:58:51 user nova-compute[75703]:   <features>
Nov 10 14:58:51 user nova-compute[75703]:     <acpi/>
Nov 10 14:58:51 user nova-compute[75703]:     <apic/>
Nov 10 14:58:51 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:58:51 user nova-compute[75703]:   </features>
Nov 10 14:58:51 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:58:51 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:58:51 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:58:51 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:58:51 user nova-compute[75703]:   </clock>
Nov 10 14:58:51 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:58:51 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:58:51 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:58:51 user nova-compute[75703]:   </cpu>
Nov 10 14:58:51 user nova-compute[75703]:   <devices>
Nov 10 14:58:51 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:58:51 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:58:51 user nova-compute[75703]:       <source dev="/dev/sdd"/>
Nov 10 14:58:51 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:58:51 user nova-compute[75703]:       <serial>62b52bf0-2fab-418c-b846-8e9ddf1e58b9</serial>
Nov 10 14:58:51 user nova-compute[75703]:     </disk>
Nov 10 14:58:51 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:58:51 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:58:51 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue"/>
Nov 10 14:58:51 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 14:58:51 user nova-compute[75703]:       <boot order="1"/>
Nov 10 14:58:51 user nova-compute[75703]:     </disk>
Nov 10 14:58:51 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:58:51 user nova-compute[75703]:       <mac address="fa:16:3e:be:bc:45"/>
Nov 10 14:58:51 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:58:51 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:58:51 user nova-compute[75703]:       <target dev="tap539018f0-1a"/>
Nov 10 14:58:51 user nova-compute[75703]:     </interface>
Nov 10 14:58:51 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:58:51 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/console.log" append="off"/>
Nov 10 14:58:51 user nova-compute[75703]:     </serial>
Nov 10 14:58:51 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:58:51 user nova-compute[75703]:     <video>
Nov 10 14:58:51 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:58:51 user nova-compute[75703]:     </video>
Nov 10 14:58:51 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:58:51 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:58:51 user nova-compute[75703]:     </rng>
Nov 10 14:58:51 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:58:51 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:58:51 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:58:51 user nova-compute[75703]:     </memballoon>
Nov 10 14:58:51 user nova-compute[75703]:   </devices>
Nov 10 14:58:51 user nova-compute[75703]: </domain>
Nov 10 14:58:51 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:58:51 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance destroyed successfully.
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:58:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] No VIF found with MAC fa:16:3e:be:bc:45, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:58:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-61523628-c0b6-4a4c-9e4c-dac1c8e35d76 req-9a1997cf-8abf-4ca8-8a3e-e21e722d966e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-61523628-c0b6-4a4c-9e4c-dac1c8e35d76 req-9a1997cf-8abf-4ca8-8a3e-e21e722d966e service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-61523628-c0b6-4a4c-9e4c-dac1c8e35d76 req-9a1997cf-8abf-4ca8-8a3e-e21e722d966e service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-61523628-c0b6-4a4c-9e4c-dac1c8e35d76 req-9a1997cf-8abf-4ca8-8a3e-e21e722d966e service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-61523628-c0b6-4a4c-9e4c-dac1c8e35d76 req-9a1997cf-8abf-4ca8-8a3e-e21e722d966e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:53 user nova-compute[75703]: WARNING nova.compute.manager [req-61523628-c0b6-4a4c-9e4c-dac1c8e35d76 req-9a1997cf-8abf-4ca8-8a3e-e21e722d966e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state active and task_state rescuing.
Nov 10 14:58:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:54 user nova-compute[75703]: INFO nova.compute.manager [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Terminating instance
Nov 10 14:58:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:55 user nova-compute[75703]: WARNING nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state active and task_state rescuing.
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-vif-unplugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] No waiting events found dispatching network-vif-unplugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-vif-unplugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Acquiring lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] No waiting events found dispatching network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:58:55 user nova-compute[75703]: WARNING nova.compute.manager [req-1f991d5e-c3c8-4123-b481-386f1084954a req-23375d9f-ba6f-4979-bc84-3405a3f0ec27 service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received unexpected event network-vif-plugged-e7f2fc4f-086b-43a4-9f63-307b86e67417 for instance with vm_state active and task_state deleting.
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-eaaefd0c-ac39-4822-a1cd-065eab1901e7 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:58:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Instance destroyed successfully.
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.objects.instance [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lazy-loading 'resources' on Instance uuid 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-83423106',display_name='tempest-ServersNegativeTestJSON-server-83423106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-83423106',id=30,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:57:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='482ca92ae18d432da1805be8bcdb88dd',ramdisk_id='',reservation_id='r-l6j7q0aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2142185333',owner_user_name='tempest-ServersNegativeTestJSON-2142185333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:57:13Z,user_data=None,user_id='9806be7af5fd410d971f2384899eab85',uuid=92d1fcb9-de3a-4b51-97bb-81ce39e8dd27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converting VIF {"id": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "address": "fa:16:3e:3c:d0:80", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f2fc4f-08", "ovs_interfaceid": "e7f2fc4f-086b-43a4-9f63-307b86e67417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG os_vif [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f2fc4f-08, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66864d2a-d788-4e0a-97b4-bf5992c4dbcc) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:58:55 user nova-compute[75703]: INFO os_vif [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:d0:80,bridge_name='br-int',has_traffic_filtering=True,id=e7f2fc4f-086b-43a4-9f63-307b86e67417,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f2fc4f-08')
Nov 10 14:58:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Deleting instance files /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27_del
Nov 10 14:58:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Deletion of /opt/stack/data/nova/instances/92d1fcb9-de3a-4b51-97bb-81ce39e8dd27_del complete
Nov 10 14:58:55 user nova-compute[75703]: INFO nova.compute.manager [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 14:58:55 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 14:58:55 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 14:58:56 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:58:56 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Took 0.45 seconds to deallocate network for instance.
Nov 10 14:58:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:58:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:58:56 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:58:56 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:58:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:56 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Deleted allocations for instance 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27
Nov 10 14:58:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-60c2279a-51b7-463d-ace7-83ee2ad63298 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "92d1fcb9-de3a-4b51-97bb-81ce39e8dd27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:58:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-ece6c120-1beb-47e2-8352-08060c9171f5 req-c88b7893-64ac-431f-b23c-6f5a03560fab service nova] [instance: 92d1fcb9-de3a-4b51-97bb-81ce39e8dd27] Received event network-vif-deleted-e7f2fc4f-086b-43a4-9f63-307b86e67417 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:58:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:58:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 14:59:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:04 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 14:59:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:09 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=24.830974578857422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 36a3590e-c24d-459e-8a32-6f13a4e10498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 14:59:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 14:59:10 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:59:10 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:59:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 14:59:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 14:59:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updating instance_info_cache with network_info: [{"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-40bbbbf2-cfbd-4658-96e1-bbf165da94dc" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:59:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:18 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:59:18 user nova-compute[75703]: INFO nova.compute.claims [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Claim successful on node user
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:59:19 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.policy [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b7b8488f5964719b7b47ac4416c59ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703fd918f4547218ac7ef97d6b1bbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:59:19 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Creating image(s)
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_power_states {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:59:19 user nova-compute[75703]: INFO nova.compute.claims [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Claim successful on node user
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk 1073741824" returned: 0 in 0.063s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:20 user nova-compute[75703]: WARNING nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 642d3e1d-4973-4759-8396-0cf73dcfce41 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 40bbbbf2-cfbd-4658-96e1-bbf165da94dc {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 1a4d9342-78d9-47df-b1c8-1fa64fcb13da {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "e1842482-4120-40ff-843d-6395f6b14960" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Successfully created port: 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.241s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.196s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.197s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "e1842482-4120-40ff-843d-6395f6b14960" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.196s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.195s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Cannot resize image /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Ensure instance console log exists: /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.856s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:59:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:59:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Successfully updated port: 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.policy [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc195ba455c543f48890aabad053a51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26adf4a92cac4e7bb607d3edbe30b087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing instance network info cache due to event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:59:21 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Creating image(s)
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "/opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "/opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "/opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.194s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance network_info: |[{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.neutron [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Start _get_guest_xml network_info=[{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:21 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:21 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk 1073741824" returned: 0 in 0.079s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2033951572',display_name='tempest-ServerRescueNegativeTestJSON-server-2033951572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2033951572',id=32,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwrLMbJcntOzGAehkzazcvpfUoRQDHzTSvqbBpVmgdiRUE6OVIDvi4D6P4wplVbIfblCWp6TcYTE9WI0uNMtZj4CyCCGXODKrPYHowANO1Ca63O0oj8e+1JgCv1jxCWqg==',key_name='tempest-keypair-108299880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-50ne7ebz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=b2a88db7-fb55-4fea-b1eb-b3550a8b3000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.objects.instance [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'pci_devices' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:59:21 user nova-compute[75703]:   <uuid>b2a88db7-fb55-4fea-b1eb-b3550a8b3000</uuid>
Nov 10 14:59:21 user nova-compute[75703]:   <name>instance-00000020</name>
Nov 10 14:59:21 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:59:21 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:59:21 user nova-compute[75703]:   <metadata>
Nov 10 14:59:21 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:59:21 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:59:21 user nova-compute[75703]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2033951572</nova:name>
Nov 10 14:59:21 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:59:21</nova:creationTime>
Nov 10 14:59:21 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:59:21 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:59:21 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:59:21 user nova-compute[75703]:       <nova:owner>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:user uuid="6b7b8488f5964719b7b47ac4416c59ea">tempest-ServerRescueNegativeTestJSON-1926780524-project-member</nova:user>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:project uuid="5703fd918f4547218ac7ef97d6b1bbdc">tempest-ServerRescueNegativeTestJSON-1926780524</nova:project>
Nov 10 14:59:21 user nova-compute[75703]:       </nova:owner>
Nov 10 14:59:21 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:59:21 user nova-compute[75703]:       <nova:ports>
Nov 10 14:59:21 user nova-compute[75703]:         <nova:port uuid="3e6b5d1a-ff60-4a01-928b-e3ce75ec6875">
Nov 10 14:59:21 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 14:59:21 user nova-compute[75703]:         </nova:port>
Nov 10 14:59:21 user nova-compute[75703]:       </nova:ports>
Nov 10 14:59:21 user nova-compute[75703]:     </nova:instance>
Nov 10 14:59:21 user nova-compute[75703]:   </metadata>
Nov 10 14:59:21 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:59:21 user nova-compute[75703]:     <system>
Nov 10 14:59:21 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:59:21 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:59:21 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:59:21 user nova-compute[75703]:       <entry name="serial">b2a88db7-fb55-4fea-b1eb-b3550a8b3000</entry>
Nov 10 14:59:21 user nova-compute[75703]:       <entry name="uuid">b2a88db7-fb55-4fea-b1eb-b3550a8b3000</entry>
Nov 10 14:59:21 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:59:21 user nova-compute[75703]:     </system>
Nov 10 14:59:21 user nova-compute[75703]:   </sysinfo>
Nov 10 14:59:21 user nova-compute[75703]:   <os>
Nov 10 14:59:21 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:59:21 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:59:21 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:59:21 user nova-compute[75703]:   </os>
Nov 10 14:59:21 user nova-compute[75703]:   <features>
Nov 10 14:59:21 user nova-compute[75703]:     <acpi/>
Nov 10 14:59:21 user nova-compute[75703]:     <apic/>
Nov 10 14:59:21 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:59:21 user nova-compute[75703]:   </features>
Nov 10 14:59:21 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:59:21 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:59:21 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:59:21 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:59:21 user nova-compute[75703]:   </clock>
Nov 10 14:59:21 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:59:21 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:59:21 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:59:21 user nova-compute[75703]:   </cpu>
Nov 10 14:59:21 user nova-compute[75703]:   <devices>
Nov 10 14:59:21 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:59:21 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:59:21 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk"/>
Nov 10 14:59:21 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:59:21 user nova-compute[75703]:     </disk>
Nov 10 14:59:21 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:59:21 user nova-compute[75703]:       <mac address="fa:16:3e:00:c8:85"/>
Nov 10 14:59:21 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:21 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:59:21 user nova-compute[75703]:       <target dev="tap3e6b5d1a-ff"/>
Nov 10 14:59:21 user nova-compute[75703]:     </interface>
Nov 10 14:59:21 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:59:21 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/console.log" append="off"/>
Nov 10 14:59:21 user nova-compute[75703]:     </serial>
Nov 10 14:59:21 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:59:21 user nova-compute[75703]:     <video>
Nov 10 14:59:21 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:21 user nova-compute[75703]:     </video>
Nov 10 14:59:21 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:59:21 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:59:21 user nova-compute[75703]:     </rng>
Nov 10 14:59:21 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:59:21 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:59:21 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:59:21 user nova-compute[75703]:     </memballoon>
Nov 10 14:59:21 user nova-compute[75703]:   </devices>
Nov 10 14:59:21 user nova-compute[75703]: </domain>
Nov 10 14:59:21 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2033951572',display_name='tempest-ServerRescueNegativeTestJSON-server-2033951572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2033951572',id=32,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwrLMbJcntOzGAehkzazcvpfUoRQDHzTSvqbBpVmgdiRUE6OVIDvi4D6P4wplVbIfblCWp6TcYTE9WI0uNMtZj4CyCCGXODKrPYHowANO1Ca63O0oj8e+1JgCv1jxCWqg==',key_name='tempest-keypair-108299880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-50ne7ebz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=b2a88db7-fb55-4fea-b1eb-b3550a8b3000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG os_vif [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23e27770-005a-54ce-8efa-1f40b5c67d5d', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e6b5d1a-ff, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e6b5d1a-ff, col_values=(('qos', UUID('347d370d-2e22-4eae-bd5f-2fcfb59c3a5a')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e6b5d1a-ff, col_values=(('external_ids', {'iface-id': '3e6b5d1a-ff60-4a01-928b-e3ce75ec6875', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:c8:85', 'vm-uuid': 'b2a88db7-fb55-4fea-b1eb-b3550a8b3000'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:21 user nova-compute[75703]: INFO os_vif [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff')
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:00:c8:85, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Successfully created port: 6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Cannot resize image /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Ensure instance console log exists: /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updated VIF entry in instance network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8bd59cf1-bbe7-4019-9b7d-a4b05e7b16dd req-a3f2e364-4632-4d89-b138-9c4e39cdfa97 service nova] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Successfully updated port: 6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "refresh_cache-17ab0956-341f-4367-bbaa-4c84411d0b0b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquired lock "refresh_cache-17ab0956-341f-4367-bbaa-4c84411d0b0b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-changed-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Refreshing instance network info cache due to event network-changed-6eda7121-dea8-4797-a2cf-ad8c264a2369. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] Acquiring lock "refresh_cache-17ab0956-341f-4367-bbaa-4c84411d0b0b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Updating instance_info_cache with network_info: [{"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Releasing lock "refresh_cache-17ab0956-341f-4367-bbaa-4c84411d0b0b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Instance network_info: |[{"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] Acquired lock "refresh_cache-17ab0956-341f-4367-bbaa-4c84411d0b0b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Refreshing network info cache for port 6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Start _get_guest_xml network_info=[{"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:59:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-584580713',display_name='tempest-VolumesNegativeTest-instance-584580713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-584580713',id=33,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26adf4a92cac4e7bb607d3edbe30b087',ramdisk_id='',reservation_id='r-7ii577oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1029237373',owner_user_name='tempest-VolumesNegativeTest-1029237373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:21Z,user_data=None,user_id='cc195ba455c543f48890aabad053a51c',uuid=17ab0956-341f-4367-bbaa-4c84411d0b0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Converting VIF {"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.objects.instance [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lazy-loading 'pci_devices' on Instance uuid 17ab0956-341f-4367-bbaa-4c84411d0b0b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:59:23 user nova-compute[75703]:   <uuid>17ab0956-341f-4367-bbaa-4c84411d0b0b</uuid>
Nov 10 14:59:23 user nova-compute[75703]:   <name>instance-00000021</name>
Nov 10 14:59:23 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:59:23 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:59:23 user nova-compute[75703]:   <metadata>
Nov 10 14:59:23 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:59:23 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:59:23 user nova-compute[75703]:       <nova:name>tempest-VolumesNegativeTest-instance-584580713</nova:name>
Nov 10 14:59:23 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:59:23</nova:creationTime>
Nov 10 14:59:23 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:59:23 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:59:23 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:59:23 user nova-compute[75703]:       <nova:owner>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:user uuid="cc195ba455c543f48890aabad053a51c">tempest-VolumesNegativeTest-1029237373-project-member</nova:user>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:project uuid="26adf4a92cac4e7bb607d3edbe30b087">tempest-VolumesNegativeTest-1029237373</nova:project>
Nov 10 14:59:23 user nova-compute[75703]:       </nova:owner>
Nov 10 14:59:23 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 14:59:23 user nova-compute[75703]:       <nova:ports>
Nov 10 14:59:23 user nova-compute[75703]:         <nova:port uuid="6eda7121-dea8-4797-a2cf-ad8c264a2369">
Nov 10 14:59:23 user nova-compute[75703]:           <nova:ip type="fixed" address="192.168.233.163" ipVersion="4"/>
Nov 10 14:59:23 user nova-compute[75703]:         </nova:port>
Nov 10 14:59:23 user nova-compute[75703]:       </nova:ports>
Nov 10 14:59:23 user nova-compute[75703]:     </nova:instance>
Nov 10 14:59:23 user nova-compute[75703]:   </metadata>
Nov 10 14:59:23 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:59:23 user nova-compute[75703]:     <system>
Nov 10 14:59:23 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:59:23 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:59:23 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:59:23 user nova-compute[75703]:       <entry name="serial">17ab0956-341f-4367-bbaa-4c84411d0b0b</entry>
Nov 10 14:59:23 user nova-compute[75703]:       <entry name="uuid">17ab0956-341f-4367-bbaa-4c84411d0b0b</entry>
Nov 10 14:59:23 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:59:23 user nova-compute[75703]:     </system>
Nov 10 14:59:23 user nova-compute[75703]:   </sysinfo>
Nov 10 14:59:23 user nova-compute[75703]:   <os>
Nov 10 14:59:23 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:59:23 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:59:23 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:59:23 user nova-compute[75703]:   </os>
Nov 10 14:59:23 user nova-compute[75703]:   <features>
Nov 10 14:59:23 user nova-compute[75703]:     <acpi/>
Nov 10 14:59:23 user nova-compute[75703]:     <apic/>
Nov 10 14:59:23 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:59:23 user nova-compute[75703]:   </features>
Nov 10 14:59:23 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:59:23 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:59:23 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:59:23 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:59:23 user nova-compute[75703]:   </clock>
Nov 10 14:59:23 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:59:23 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:59:23 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:59:23 user nova-compute[75703]:   </cpu>
Nov 10 14:59:23 user nova-compute[75703]:   <devices>
Nov 10 14:59:23 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:59:23 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:59:23 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk"/>
Nov 10 14:59:23 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:59:23 user nova-compute[75703]:     </disk>
Nov 10 14:59:23 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:59:23 user nova-compute[75703]:       <mac address="fa:16:3e:c5:00:f4"/>
Nov 10 14:59:23 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:23 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:59:23 user nova-compute[75703]:       <target dev="tap6eda7121-de"/>
Nov 10 14:59:23 user nova-compute[75703]:     </interface>
Nov 10 14:59:23 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:59:23 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/console.log" append="off"/>
Nov 10 14:59:23 user nova-compute[75703]:     </serial>
Nov 10 14:59:23 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:59:23 user nova-compute[75703]:     <video>
Nov 10 14:59:23 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:23 user nova-compute[75703]:     </video>
Nov 10 14:59:23 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:59:23 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:59:23 user nova-compute[75703]:     </rng>
Nov 10 14:59:23 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:59:23 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:59:23 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:59:23 user nova-compute[75703]:     </memballoon>
Nov 10 14:59:23 user nova-compute[75703]:   </devices>
Nov 10 14:59:23 user nova-compute[75703]: </domain>
Nov 10 14:59:23 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-584580713',display_name='tempest-VolumesNegativeTest-instance-584580713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-584580713',id=33,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26adf4a92cac4e7bb607d3edbe30b087',ramdisk_id='',reservation_id='r-7ii577oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1029237373',owner_user_name='tempest-VolumesNegativeTest-1029237373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:21Z,user_data=None,user_id='cc195ba455c543f48890aabad053a51c',uuid=17ab0956-341f-4367-bbaa-4c84411d0b0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Converting VIF {"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG os_vif [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b706af9-6514-5d66-b6d1-51a58a61c3b2', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eda7121-de, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eda7121-de, col_values=(('qos', UUID('c85ebca4-e715-4a93-8e7e-c92385062da4')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eda7121-de, col_values=(('external_ids', {'iface-id': '6eda7121-dea8-4797-a2cf-ad8c264a2369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:00:f4', 'vm-uuid': '17ab0956-341f-4367-bbaa-4c84411d0b0b'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: INFO os_vif [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de')
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] No VIF found with MAC fa:16:3e:c5:00:f4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:59:23 user nova-compute[75703]: INFO nova.compute.claims [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Claim successful on node user
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff9e3702-2f42-487e-8161-59dcdde12906 req-31bbd44e-281d-4302-a8a9-c7fbde93c8e9 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff9e3702-2f42-487e-8161-59dcdde12906 req-31bbd44e-281d-4302-a8a9-c7fbde93c8e9 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff9e3702-2f42-487e-8161-59dcdde12906 req-31bbd44e-281d-4302-a8a9-c7fbde93c8e9 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff9e3702-2f42-487e-8161-59dcdde12906 req-31bbd44e-281d-4302-a8a9-c7fbde93c8e9 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff9e3702-2f42-487e-8161-59dcdde12906 req-31bbd44e-281d-4302-a8a9-c7fbde93c8e9 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:23 user nova-compute[75703]: WARNING nova.compute.manager [req-ff9e3702-2f42-487e-8161-59dcdde12906 req-31bbd44e-281d-4302-a8a9-c7fbde93c8e9 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state building and task_state spawning.
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Updated VIF entry in instance network info cache for port 6eda7121-dea8-4797-a2cf-ad8c264a2369. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Updating instance_info_cache with network_info: [{"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-22b36f7d-ee2e-46ec-948c-d2829d656a9d req-453c648d-4aeb-456f-bc7e-82c674fe684b service nova] Releasing lock "refresh_cache-17ab0956-341f-4367-bbaa-4c84411d0b0b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:59:24 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:59:24 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG nova.policy [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23ee54b16d604b829f2088d8e850c48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ddb2fd8ebd40b0bee398bd9969a0ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:59:24 user nova-compute[75703]: INFO nova.virt.block_device [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Booting with volume a5a52271-1341-407f-996d-95c580acc6b4 at /dev/vda
Nov 10 14:59:24 user nova-compute[75703]: DEBUG os_brick.utils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0637c0bb-15d3-4d30-a06a-a7948a991135]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e0098-1343-4282-ae9e-bb0138dce23a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d5e46-68fa-4157-8f3e-035b9e826479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93b415-076a-4ce5-9faf-b3626cf89baa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:59:24 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:59:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a2e41-ac0a-4c64-9ab8-f39bc7d49c6b]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG os_brick.utils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating existing volume attachment record: 7ef90a9a-52d5-40d8-844f-455b137a4734 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Successfully created port: 76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:59:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-24d267b9-7675-4845-a5f3-6765ed0ae412 req-52bedd85-cb7e-4afb-b1ed-2fcc545700f5 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-24d267b9-7675-4845-a5f3-6765ed0ae412 req-52bedd85-cb7e-4afb-b1ed-2fcc545700f5 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-24d267b9-7675-4845-a5f3-6765ed0ae412 req-52bedd85-cb7e-4afb-b1ed-2fcc545700f5 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-24d267b9-7675-4845-a5f3-6765ed0ae412 req-52bedd85-cb7e-4afb-b1ed-2fcc545700f5 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-24d267b9-7675-4845-a5f3-6765ed0ae412 req-52bedd85-cb7e-4afb-b1ed-2fcc545700f5 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:25 user nova-compute[75703]: WARNING nova.compute.manager [req-24d267b9-7675-4845-a5f3-6765ed0ae412 req-52bedd85-cb7e-4afb-b1ed-2fcc545700f5 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state building and task_state spawning.
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Successfully updated port: 76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquired lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-changed-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Refreshing instance network info cache due to event network-changed-76e9185b-15b2-42d6-a80f-b57c6d226695. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] Acquiring lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-da1d294f-3555-4dc2-9c6f-508c0d8677dd req-a82dcad0-94cf-4a26-92c6-d5e3669c2ac3 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-da1d294f-3555-4dc2-9c6f-508c0d8677dd req-a82dcad0-94cf-4a26-92c6-d5e3669c2ac3 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-da1d294f-3555-4dc2-9c6f-508c0d8677dd req-a82dcad0-94cf-4a26-92c6-d5e3669c2ac3 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-da1d294f-3555-4dc2-9c6f-508c0d8677dd req-a82dcad0-94cf-4a26-92c6-d5e3669c2ac3 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-da1d294f-3555-4dc2-9c6f-508c0d8677dd req-a82dcad0-94cf-4a26-92c6-d5e3669c2ac3 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:25 user nova-compute[75703]: WARNING nova.compute.manager [req-da1d294f-3555-4dc2-9c6f-508c0d8677dd req-a82dcad0-94cf-4a26-92c6-d5e3669c2ac3 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state building and task_state spawning.
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Releasing lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance network_info: |[{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] Acquired lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Refreshing network info cache for port 76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updated VIF entry in instance network info cache for port 76e9185b-15b2-42d6-a80f-b57c6d226695. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e73768a2-fbf7-40e4-a45e-caa362e2fcf9 req-595199d8-191a-4b22-9789-96f58dabbd59 service nova] Releasing lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:59:26 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance spawned successfully.
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: INFO nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Took 7.38 seconds to spawn the instance on the hypervisor.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:59:27 user nova-compute[75703]: INFO nova.compute.manager [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Took 8.33 seconds to build instance.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4f8e6f7d-fedd-4049-ba25-13f4b740de4f tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.441s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.951s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:27 user nova-compute[75703]: INFO nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-f706f2ee-7080-4997-b356-de8ad8279b4a req-335e9f76-6261-487b-987e-4466dc0bb3e0 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f706f2ee-7080-4997-b356-de8ad8279b4a req-335e9f76-6261-487b-987e-4466dc0bb3e0 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f706f2ee-7080-4997-b356-de8ad8279b4a req-335e9f76-6261-487b-987e-4466dc0bb3e0 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f706f2ee-7080-4997-b356-de8ad8279b4a req-335e9f76-6261-487b-987e-4466dc0bb3e0 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-f706f2ee-7080-4997-b356-de8ad8279b4a req-335e9f76-6261-487b-987e-4466dc0bb3e0 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:27 user nova-compute[75703]: WARNING nova.compute.manager [req-f706f2ee-7080-4997-b356-de8ad8279b4a req-335e9f76-6261-487b-987e-4466dc0bb3e0 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state building and task_state spawning.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:59:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Instance spawned successfully.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:27 user nova-compute[75703]: INFO nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:59:27 user nova-compute[75703]: INFO nova.compute.manager [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Took 7.94 seconds to build instance.
Nov 10 14:59:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-76106c83-31e0-4fb9-a1dc-ecf2f7a5c798 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.070s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:59:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:59:36 user nova-compute[75703]: INFO nova.compute.claims [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Claim successful on node user
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:59:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.policy [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbf6ec70894948e4886371fc014fc732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22eaeb977349819aabde01a3b34930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:59:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Creating image(s)
Nov 10 14:59:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "/opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "/opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "193a886c68eb8209ca1ea3eac6dc64823fcab9d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "193a886c68eb8209ca1ea3eac6dc64823fcab9d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Successfully created port: a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.virt.images [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] 0e09412e-7806-4340-a81b-d184c57341fb was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.part /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.part /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.converted" returned: 0 in 0.321s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "193a886c68eb8209ca1ea3eac6dc64823fcab9d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.265s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Successfully updated port: a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing instance network info cache due to event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:59:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "193a886c68eb8209ca1ea3eac6dc64823fcab9d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "193a886c68eb8209ca1ea3eac6dc64823fcab9d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 --force-share --output=json" returned: 0 in 0.236s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7,backing_fmt=raw /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7,backing_fmt=raw /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk 1073741824" returned: 0 in 0.057s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "193a886c68eb8209ca1ea3eac6dc64823fcab9d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance network_info: |[{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Cannot resize image /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Ensure instance console log exists: /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Start _get_guest_xml network_info=[{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:59:33Z,direct_url=<?>,disk_format='qcow2',id=0e09412e-7806-4340-a81b-d184c57341fb,min_disk=0,min_ram=0,name='tempest-scenario-img--281002288',owner='6b22eaeb977349819aabde01a3b34930',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:59:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '0e09412e-7806-4340-a81b-d184c57341fb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:59:39 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:39 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:59:33Z,direct_url=<?>,disk_format='qcow2',id=0e09412e-7806-4340-a81b-d184c57341fb,min_disk=0,min_ram=0,name='tempest-scenario-img--281002288',owner='6b22eaeb977349819aabde01a3b34930',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:59:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-184206598',display_name='tempest-TestMinimumBasicScenario-server-184206598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-184206598',id=35,image_ref='0e09412e-7806-4340-a81b-d184c57341fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiQvXorGkVXxJ5nper0AW5yLmi7ga3Hz2aZ8j/dEZpCVrotQEMFA7rxmNCQTxeN4EuFv/du0zlRNk7HePqTRa2e9ZFkpDAnKTPUS4QqPg46Usay9fqTDLrT8Ua7JP+C9w==',key_name='tempest-TestMinimumBasicScenario-641668031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-tpjdixlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0e09412e-7806-4340-a81b-d184c57341fb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:37Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=fa433bf7-2318-4dce-b293-b3907a7ab390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'pci_devices' on Instance uuid fa433bf7-2318-4dce-b293-b3907a7ab390 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:59:39 user nova-compute[75703]:   <uuid>fa433bf7-2318-4dce-b293-b3907a7ab390</uuid>
Nov 10 14:59:39 user nova-compute[75703]:   <name>instance-00000023</name>
Nov 10 14:59:39 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:59:39 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:59:39 user nova-compute[75703]:   <metadata>
Nov 10 14:59:39 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:59:39 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:59:39 user nova-compute[75703]:       <nova:name>tempest-TestMinimumBasicScenario-server-184206598</nova:name>
Nov 10 14:59:39 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:59:39</nova:creationTime>
Nov 10 14:59:39 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:59:39 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:59:39 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:59:39 user nova-compute[75703]:       <nova:owner>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:user uuid="bbf6ec70894948e4886371fc014fc732">tempest-TestMinimumBasicScenario-700348367-project-member</nova:user>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:project uuid="6b22eaeb977349819aabde01a3b34930">tempest-TestMinimumBasicScenario-700348367</nova:project>
Nov 10 14:59:39 user nova-compute[75703]:       </nova:owner>
Nov 10 14:59:39 user nova-compute[75703]:       <nova:root type="image" uuid="0e09412e-7806-4340-a81b-d184c57341fb"/>
Nov 10 14:59:39 user nova-compute[75703]:       <nova:ports>
Nov 10 14:59:39 user nova-compute[75703]:         <nova:port uuid="a5306b79-542a-42d1-b6bf-182c7265275b">
Nov 10 14:59:39 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 14:59:39 user nova-compute[75703]:         </nova:port>
Nov 10 14:59:39 user nova-compute[75703]:       </nova:ports>
Nov 10 14:59:39 user nova-compute[75703]:     </nova:instance>
Nov 10 14:59:39 user nova-compute[75703]:   </metadata>
Nov 10 14:59:39 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:59:39 user nova-compute[75703]:     <system>
Nov 10 14:59:39 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:59:39 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:59:39 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:59:39 user nova-compute[75703]:       <entry name="serial">fa433bf7-2318-4dce-b293-b3907a7ab390</entry>
Nov 10 14:59:39 user nova-compute[75703]:       <entry name="uuid">fa433bf7-2318-4dce-b293-b3907a7ab390</entry>
Nov 10 14:59:39 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:59:39 user nova-compute[75703]:     </system>
Nov 10 14:59:39 user nova-compute[75703]:   </sysinfo>
Nov 10 14:59:39 user nova-compute[75703]:   <os>
Nov 10 14:59:39 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:59:39 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:59:39 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:59:39 user nova-compute[75703]:   </os>
Nov 10 14:59:39 user nova-compute[75703]:   <features>
Nov 10 14:59:39 user nova-compute[75703]:     <acpi/>
Nov 10 14:59:39 user nova-compute[75703]:     <apic/>
Nov 10 14:59:39 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:59:39 user nova-compute[75703]:   </features>
Nov 10 14:59:39 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:59:39 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:59:39 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:59:39 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:59:39 user nova-compute[75703]:   </clock>
Nov 10 14:59:39 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:59:39 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:59:39 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:59:39 user nova-compute[75703]:   </cpu>
Nov 10 14:59:39 user nova-compute[75703]:   <devices>
Nov 10 14:59:39 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 14:59:39 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 14:59:39 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk"/>
Nov 10 14:59:39 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:59:39 user nova-compute[75703]:     </disk>
Nov 10 14:59:39 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:59:39 user nova-compute[75703]:       <mac address="fa:16:3e:3d:c9:5a"/>
Nov 10 14:59:39 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:39 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:59:39 user nova-compute[75703]:       <target dev="tapa5306b79-54"/>
Nov 10 14:59:39 user nova-compute[75703]:     </interface>
Nov 10 14:59:39 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:59:39 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/console.log" append="off"/>
Nov 10 14:59:39 user nova-compute[75703]:     </serial>
Nov 10 14:59:39 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:59:39 user nova-compute[75703]:     <video>
Nov 10 14:59:39 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:39 user nova-compute[75703]:     </video>
Nov 10 14:59:39 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:59:39 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:59:39 user nova-compute[75703]:     </rng>
Nov 10 14:59:39 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:59:39 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:59:39 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:59:39 user nova-compute[75703]:     </memballoon>
Nov 10 14:59:39 user nova-compute[75703]:   </devices>
Nov 10 14:59:39 user nova-compute[75703]: </domain>
Nov 10 14:59:39 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-184206598',display_name='tempest-TestMinimumBasicScenario-server-184206598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-184206598',id=35,image_ref='0e09412e-7806-4340-a81b-d184c57341fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiQvXorGkVXxJ5nper0AW5yLmi7ga3Hz2aZ8j/dEZpCVrotQEMFA7rxmNCQTxeN4EuFv/du0zlRNk7HePqTRa2e9ZFkpDAnKTPUS4QqPg46Usay9fqTDLrT8Ua7JP+C9w==',key_name='tempest-TestMinimumBasicScenario-641668031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-tpjdixlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0e09412e-7806-4340-a81b-d184c57341fb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:37Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=fa433bf7-2318-4dce-b293-b3907a7ab390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG os_vif [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b2f59b1-86ef-5fe1-99f0-0e4c1f7e3d7c', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5306b79-54, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5306b79-54, col_values=(('qos', UUID('6de02ec0-9b2d-4127-9eca-12d6d3fed700')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5306b79-54, col_values=(('external_ids', {'iface-id': 'a5306b79-542a-42d1-b6bf-182c7265275b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:c9:5a', 'vm-uuid': 'fa433bf7-2318-4dce-b293-b3907a7ab390'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:39 user nova-compute[75703]: INFO os_vif [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54')
Nov 10 14:59:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:59:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No VIF found with MAC fa:16:3e:3d:c9:5a, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:59:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updated VIF entry in instance network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:59:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3e1f69bb-57e0-4d28-b15e-d679eac5d77e req-698cb224-b395-4e44-802b-245936ce0799 service nova] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-f568e781-fdf2-4d0a-b08c-88e93204492b req-e603bba6-6081-4495-ac03-f0007d02c0e4 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f568e781-fdf2-4d0a-b08c-88e93204492b req-e603bba6-6081-4495-ac03-f0007d02c0e4 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f568e781-fdf2-4d0a-b08c-88e93204492b req-e603bba6-6081-4495-ac03-f0007d02c0e4 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f568e781-fdf2-4d0a-b08c-88e93204492b req-e603bba6-6081-4495-ac03-f0007d02c0e4 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-f568e781-fdf2-4d0a-b08c-88e93204492b req-e603bba6-6081-4495-ac03-f0007d02c0e4 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:41 user nova-compute[75703]: WARNING nova.compute.manager [req-f568e781-fdf2-4d0a-b08c-88e93204492b req-e603bba6-6081-4495-ac03-f0007d02c0e4 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state building and task_state spawning.
Nov 10 14:59:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-a7b01897-aee8-475e-8688-ac4e72537442 req-f0e600e3-b8b8-4a13-95a2-3273fbefbc84 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a7b01897-aee8-475e-8688-ac4e72537442 req-f0e600e3-b8b8-4a13-95a2-3273fbefbc84 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a7b01897-aee8-475e-8688-ac4e72537442 req-f0e600e3-b8b8-4a13-95a2-3273fbefbc84 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a7b01897-aee8-475e-8688-ac4e72537442 req-f0e600e3-b8b8-4a13-95a2-3273fbefbc84 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-a7b01897-aee8-475e-8688-ac4e72537442 req-f0e600e3-b8b8-4a13-95a2-3273fbefbc84 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:43 user nova-compute[75703]: WARNING nova.compute.manager [req-a7b01897-aee8-475e-8688-ac4e72537442 req-f0e600e3-b8b8-4a13-95a2-3273fbefbc84 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state building and task_state spawning.
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:59:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance spawned successfully.
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:43 user nova-compute[75703]: INFO nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 10 14:59:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:59:44 user nova-compute[75703]: INFO nova.compute.manager [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Took 7.53 seconds to build instance.
Nov 10 14:59:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0660a247-6499-41c6-a68d-46e394a2f752 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.687s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 14:59:46 user nova-compute[75703]: INFO nova.compute.claims [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Claim successful on node user
Nov 10 14:59:46 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 14:59:46 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 14:59:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 14:59:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG nova.policy [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67a5a4845f164d8cba0951d82f2430e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c013cf84f8b414ba6d2d888ddc2ee1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 14:59:47 user nova-compute[75703]: INFO nova.virt.block_device [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Booting with volume dccea566-e663-4d55-97b8-1b5796f6d575 at /dev/vda
Nov 10 14:59:47 user nova-compute[75703]: DEBUG os_brick.utils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d06c85-09b5-491f-bbd7-874ddb28f564]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77644f7-3a67-4615-a1db-24bdf5e7253e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c3a73-6a63-432e-b96d-8299a90a8665]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5bbd5-b770-4851-9b48-01bf6ecbb0ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 14:59:47 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 14:59:47 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d6d96b-5805-4cd3-b61e-467d17a55b09]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG os_brick.utils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updating existing volume attachment record: 9f9c548d-3b54-44b7-88f5-574a59946183 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 14:59:47 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Successfully created port: 1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Successfully updated port: 1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquired lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-changed-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Refreshing instance network info cache due to event network-changed-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] Acquiring lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updating instance_info_cache with network_info: [{"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Releasing lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Instance network_info: |[{"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] Acquired lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:48 user nova-compute[75703]: DEBUG nova.network.neutron [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Refreshing network info cache for port 1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:59:49 user nova-compute[75703]: DEBUG nova.network.neutron [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updated VIF entry in instance network info cache for port 1a8f0f29-2317-44c0-b2c9-96b35b3aaeab. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:59:49 user nova-compute[75703]: DEBUG nova.network.neutron [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updating instance_info_cache with network_info: [{"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2d3b703c-61c0-45ee-b99e-4f35d588de8f req-115d2497-cc0d-4f60-b653-397d04a385cd service nova] Releasing lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 14:59:51 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Creating image(s)
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Ensure instance console log exists: /opt/stack/data/nova/instances/a660d0a5-43a3-4ded-8176-316bf54c556a/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Start _get_guest_xml network_info=[{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '7ef90a9a-52d5-40d8-844f-455b137a4734', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a660d0a5-43a3-4ded-8176-316bf54c556a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5a52271-1341-407f-996d-95c580acc6b4', 'serial': 'a5a52271-1341-407f-996d-95c580acc6b4'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 14:59:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 14:59:51 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:59:51 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 14:59:51 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b3266-ccdd-4da2-80ff-1fd522812847]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 14:59:51 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[11550ddb-1dd0-4608-a79b-895d3d1e3dfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4] added
Nov 10 14:59:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e990e8-53df-4f12-b99e-b4119b22df84]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e36e2-2390-49ff-9514-138c067baac3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrTIqMny {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrTIqMny" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d4fbbb-c817-4a7b-b7d7-bb8c9618636e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrTIqMny'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4474d94a-9127-4c28-9a8a-8e40b3579698]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c397c389-4f4e-469e-8141-722d5dae6768]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:59:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:59:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:59:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:59:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d276b1-89b5-40d1-a192-fd7fe5ffed4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]
Nov 10 14:59:51 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.
Nov 10 14:59:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d3e5e-f17f-41d9-85f4-7a066b104610]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2359d26-5cb1-41f1-a7c4-b5ea1d771e2b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:59:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:59:51 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 14:59:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 14:59:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 14:59:51 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 14:59:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[447c13cf-08a5-4082-9a6a-45d27f5b6049]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 14:59:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26462353565643064', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462353565643064', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2099456931',display_name='tempest-ServerActionsTestOtherA-server-2099456931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2099456931',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-fcv3dmop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=a660d0a5-43a3-4ded-8176-316bf54c556a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.objects.instance [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'pci_devices' on Instance uuid a660d0a5-43a3-4ded-8176-316bf54c556a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 14:59:52 user nova-compute[75703]:   <uuid>a660d0a5-43a3-4ded-8176-316bf54c556a</uuid>
Nov 10 14:59:52 user nova-compute[75703]:   <name>instance-00000022</name>
Nov 10 14:59:52 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 14:59:52 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 14:59:52 user nova-compute[75703]:   <metadata>
Nov 10 14:59:52 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 14:59:52 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 14:59:52 user nova-compute[75703]:       <nova:name>tempest-ServerActionsTestOtherA-server-2099456931</nova:name>
Nov 10 14:59:52 user nova-compute[75703]:       <nova:creationTime>2023-11-10 14:59:51</nova:creationTime>
Nov 10 14:59:52 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 14:59:52 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 14:59:52 user nova-compute[75703]:       </nova:flavor>
Nov 10 14:59:52 user nova-compute[75703]:       <nova:owner>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:user uuid="23ee54b16d604b829f2088d8e850c48c">tempest-ServerActionsTestOtherA-1989770067-project-member</nova:user>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:project uuid="37ddb2fd8ebd40b0bee398bd9969a0ee">tempest-ServerActionsTestOtherA-1989770067</nova:project>
Nov 10 14:59:52 user nova-compute[75703]:       </nova:owner>
Nov 10 14:59:52 user nova-compute[75703]:       <nova:ports>
Nov 10 14:59:52 user nova-compute[75703]:         <nova:port uuid="76e9185b-15b2-42d6-a80f-b57c6d226695">
Nov 10 14:59:52 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 14:59:52 user nova-compute[75703]:         </nova:port>
Nov 10 14:59:52 user nova-compute[75703]:       </nova:ports>
Nov 10 14:59:52 user nova-compute[75703]:     </nova:instance>
Nov 10 14:59:52 user nova-compute[75703]:   </metadata>
Nov 10 14:59:52 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 14:59:52 user nova-compute[75703]:     <system>
Nov 10 14:59:52 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 14:59:52 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 14:59:52 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 14:59:52 user nova-compute[75703]:       <entry name="serial">a660d0a5-43a3-4ded-8176-316bf54c556a</entry>
Nov 10 14:59:52 user nova-compute[75703]:       <entry name="uuid">a660d0a5-43a3-4ded-8176-316bf54c556a</entry>
Nov 10 14:59:52 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 14:59:52 user nova-compute[75703]:     </system>
Nov 10 14:59:52 user nova-compute[75703]:   </sysinfo>
Nov 10 14:59:52 user nova-compute[75703]:   <os>
Nov 10 14:59:52 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 14:59:52 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 14:59:52 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 14:59:52 user nova-compute[75703]:   </os>
Nov 10 14:59:52 user nova-compute[75703]:   <features>
Nov 10 14:59:52 user nova-compute[75703]:     <acpi/>
Nov 10 14:59:52 user nova-compute[75703]:     <apic/>
Nov 10 14:59:52 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 14:59:52 user nova-compute[75703]:   </features>
Nov 10 14:59:52 user nova-compute[75703]:   <clock offset="utc">
Nov 10 14:59:52 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 14:59:52 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 14:59:52 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 14:59:52 user nova-compute[75703]:   </clock>
Nov 10 14:59:52 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 14:59:52 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 14:59:52 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 14:59:52 user nova-compute[75703]:   </cpu>
Nov 10 14:59:52 user nova-compute[75703]:   <devices>
Nov 10 14:59:52 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 14:59:52 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 14:59:52 user nova-compute[75703]:       <source dev="/dev/sdb"/>
Nov 10 14:59:52 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 14:59:52 user nova-compute[75703]:       <serial>a5a52271-1341-407f-996d-95c580acc6b4</serial>
Nov 10 14:59:52 user nova-compute[75703]:     </disk>
Nov 10 14:59:52 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 14:59:52 user nova-compute[75703]:       <mac address="fa:16:3e:67:61:80"/>
Nov 10 14:59:52 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:52 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 14:59:52 user nova-compute[75703]:       <target dev="tap76e9185b-15"/>
Nov 10 14:59:52 user nova-compute[75703]:     </interface>
Nov 10 14:59:52 user nova-compute[75703]:     <serial type="pty">
Nov 10 14:59:52 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/a660d0a5-43a3-4ded-8176-316bf54c556a/console.log" append="off"/>
Nov 10 14:59:52 user nova-compute[75703]:     </serial>
Nov 10 14:59:52 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 14:59:52 user nova-compute[75703]:     <video>
Nov 10 14:59:52 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 14:59:52 user nova-compute[75703]:     </video>
Nov 10 14:59:52 user nova-compute[75703]:     <rng model="virtio">
Nov 10 14:59:52 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 14:59:52 user nova-compute[75703]:     </rng>
Nov 10 14:59:52 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 14:59:52 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 14:59:52 user nova-compute[75703]:       <stats period="10"/>
Nov 10 14:59:52 user nova-compute[75703]:     </memballoon>
Nov 10 14:59:52 user nova-compute[75703]:   </devices>
Nov 10 14:59:52 user nova-compute[75703]: </domain>
Nov 10 14:59:52 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2099456931',display_name='tempest-ServerActionsTestOtherA-server-2099456931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2099456931',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-fcv3dmop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=a660d0a5-43a3-4ded-8176-316bf54c556a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG os_vif [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a40d065f-be54-5dd7-ac23-4e79b3028627', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76e9185b-15, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76e9185b-15, col_values=(('qos', UUID('848feed6-3101-4493-be78-d95d03fa42e0')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76e9185b-15, col_values=(('external_ids', {'iface-id': '76e9185b-15b2-42d6-a80f-b57c6d226695', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:61:80', 'vm-uuid': 'a660d0a5-43a3-4ded-8176-316bf54c556a'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:52 user nova-compute[75703]: INFO os_vif [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15')
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 14:59:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No VIF found with MAC fa:16:3e:67:61:80, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 14:59:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-4e71719e-53fd-4fb7-8e95-f9668d9119fc req-58521eb4-5b56-43ec-beb2-b13cfe2514fd service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4e71719e-53fd-4fb7-8e95-f9668d9119fc req-58521eb4-5b56-43ec-beb2-b13cfe2514fd service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4e71719e-53fd-4fb7-8e95-f9668d9119fc req-58521eb4-5b56-43ec-beb2-b13cfe2514fd service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4e71719e-53fd-4fb7-8e95-f9668d9119fc req-58521eb4-5b56-43ec-beb2-b13cfe2514fd service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-4e71719e-53fd-4fb7-8e95-f9668d9119fc req-58521eb4-5b56-43ec-beb2-b13cfe2514fd service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:54 user nova-compute[75703]: WARNING nova.compute.manager [req-4e71719e-53fd-4fb7-8e95-f9668d9119fc req-58521eb4-5b56-43ec-beb2-b13cfe2514fd service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state building and task_state spawning.
Nov 10 14:59:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 14:59:56 user nova-compute[75703]: WARNING nova.compute.manager [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state building and task_state spawning.
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-changed-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Refreshing instance network info cache due to event network-changed-2c05ad70-1d8d-43d9-a952-7d58ca951a8b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] Acquiring lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] Acquired lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Refreshing network info cache for port 2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 14:59:56 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance spawned successfully.
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 14:59:56 user nova-compute[75703]: INFO nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 14:59:56 user nova-compute[75703]: INFO nova.compute.manager [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Took 33.27 seconds to build instance.
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c677b9a1-fa40-4527-a842-11d0537889da tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.522s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updated VIF entry in instance network info cache for port 2c05ad70-1d8d-43d9-a952-7d58ca951a8b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updating instance_info_cache with network_info: [{"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 14:59:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9b086702-3189-48a2-830f-bd87bd3015c8 req-27f4e715-a12f-4379-9536-3af8371474cc service nova] Releasing lock "refresh_cache-36a3590e-c24d-459e-8a32-6f13a4e10498" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 14:59:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 14:59:59 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 14:59:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:00:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:00:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.173s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:02 user nova-compute[75703]: INFO nova.compute.manager [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attaching volume 1034a57e-5df3-4842-adfd-5690d0cc3907 to /dev/vdb
Nov 10 15:00:02 user nova-compute[75703]: DEBUG os_brick.utils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba9d6d7-3ab9-4643-9c8e-e369b18b6043]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d50c7-054d-42dc-96ce-5dd4c9fbe9a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f259d6-3f99-4618-8475-8e514e69141f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[30876c02-b1cf-4327-8684-509f0dcb6b91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:00:02 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:00:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d574ec80-b66f-42d4-9b58-58836d1caecb]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG os_brick.utils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updating existing volume attachment record: c51d5298-5d26-45c8-9e93-d80c5972b19c {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:00:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:00:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:10 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:00:10 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7106MB free_disk=24.711570739746094GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 36a3590e-c24d-459e-8a32-6f13a4e10498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 17ab0956-341f-4367-bbaa-4c84411d0b0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a660d0a5-43a3-4ded-8176-316bf54c556a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fa433bf7-2318-4dce-b293-b3907a7ab390 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 69cd5c16-a011-43e5-a7e1-273fd1e332b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:00:10 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:00:11 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:00:11 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:00:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:00:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:00:14 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Creating image(s)
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Ensure instance console log exists: /opt/stack/data/nova/instances/69cd5c16-a011-43e5-a7e1-273fd1e332b3/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Start _get_guest_xml network_info=[{"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '9f9c548d-3b54-44b7-88f5-574a59946183', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLozVqka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69cd5c16-a011-43e5-a7e1-273fd1e332b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'dccea566-e663-4d55-97b8-1b5796f6d575', 'serial': 'dccea566-e663-4d55-97b8-1b5796f6d575'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:00:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:00:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLozVqka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:00:14 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:00:14 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:00:14 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124a660-69a8-4e77-9b41-81c0cf9ba7e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:00:14 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[491bf563-257f-4ce2-8caf-5fcb1794f50b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575] added
Nov 10 15:00:14 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee2b6b-4fd1-40a5-8c90-cd7f3f5fa3e6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feaa78a-34c3-41c5-946b-247b2f59096a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLozVqka {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLozVqka" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c30efe6-d16f-4479-bed3-61fa20fcb298]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLozVqka'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ec1c7-aa7b-4ead-a580-7c95a955ca28]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca445dc-39ee-4211-a2d2-acd8381dc972]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[300cd94c-1e59-49fc-b555-8abe27187459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260]
Nov 10 15:00:14 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260] successful.
Nov 10 15:00:14 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[654de9db-392e-4d2c-8b26-7372edf0478a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[629564f9-956e-41e6-8748-6a1cb75fbb49]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:00:14 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[72444d25-e95e-4052-98be-6f94be75892d]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLozVqka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:00:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23862346461373836', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346461373836', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1326957089',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1326957089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1326957089',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsk3+aB4ff3xgjtO/jGm/gFET5Imi1Dl3h0TG0acAR7PMJKHMBT2cAGTm57Jq3DR3k+X7PRs68Z82OX/4WR43NjRqCUXQ/RZNWKJCxHqTSG8pD/L8SJ0qItX0zyYCE3+Q==',key_name='tempest-keypair-1844582802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-90tw4xjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=69cd5c16-a011-43e5-a7e1-273fd1e332b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'pci_devices' on Instance uuid 69cd5c16-a011-43e5-a7e1-273fd1e332b3 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:00:15 user nova-compute[75703]:   <uuid>69cd5c16-a011-43e5-a7e1-273fd1e332b3</uuid>
Nov 10 15:00:15 user nova-compute[75703]:   <name>instance-00000024</name>
Nov 10 15:00:15 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:00:15 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:00:15 user nova-compute[75703]:   <metadata>
Nov 10 15:00:15 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:00:15 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:00:15 user nova-compute[75703]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1326957089</nova:name>
Nov 10 15:00:15 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:00:14</nova:creationTime>
Nov 10 15:00:15 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:00:15 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:00:15 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:00:15 user nova-compute[75703]:       <nova:owner>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:user uuid="67a5a4845f164d8cba0951d82f2430e9">tempest-TestVolumeBootPattern-982390102-project-member</nova:user>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:project uuid="3c013cf84f8b414ba6d2d888ddc2ee1b">tempest-TestVolumeBootPattern-982390102</nova:project>
Nov 10 15:00:15 user nova-compute[75703]:       </nova:owner>
Nov 10 15:00:15 user nova-compute[75703]:       <nova:ports>
Nov 10 15:00:15 user nova-compute[75703]:         <nova:port uuid="1a8f0f29-2317-44c0-b2c9-96b35b3aaeab">
Nov 10 15:00:15 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 15:00:15 user nova-compute[75703]:         </nova:port>
Nov 10 15:00:15 user nova-compute[75703]:       </nova:ports>
Nov 10 15:00:15 user nova-compute[75703]:     </nova:instance>
Nov 10 15:00:15 user nova-compute[75703]:   </metadata>
Nov 10 15:00:15 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:00:15 user nova-compute[75703]:     <system>
Nov 10 15:00:15 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:00:15 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:00:15 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:00:15 user nova-compute[75703]:       <entry name="serial">69cd5c16-a011-43e5-a7e1-273fd1e332b3</entry>
Nov 10 15:00:15 user nova-compute[75703]:       <entry name="uuid">69cd5c16-a011-43e5-a7e1-273fd1e332b3</entry>
Nov 10 15:00:15 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:00:15 user nova-compute[75703]:     </system>
Nov 10 15:00:15 user nova-compute[75703]:   </sysinfo>
Nov 10 15:00:15 user nova-compute[75703]:   <os>
Nov 10 15:00:15 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:00:15 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:00:15 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:00:15 user nova-compute[75703]:   </os>
Nov 10 15:00:15 user nova-compute[75703]:   <features>
Nov 10 15:00:15 user nova-compute[75703]:     <acpi/>
Nov 10 15:00:15 user nova-compute[75703]:     <apic/>
Nov 10 15:00:15 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:00:15 user nova-compute[75703]:   </features>
Nov 10 15:00:15 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:00:15 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:00:15 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:00:15 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:00:15 user nova-compute[75703]:   </clock>
Nov 10 15:00:15 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:00:15 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:00:15 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:00:15 user nova-compute[75703]:   </cpu>
Nov 10 15:00:15 user nova-compute[75703]:   <devices>
Nov 10 15:00:15 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 15:00:15 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:00:15 user nova-compute[75703]:       <source dev="/dev/sdc"/>
Nov 10 15:00:15 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:00:15 user nova-compute[75703]:       <serial>dccea566-e663-4d55-97b8-1b5796f6d575</serial>
Nov 10 15:00:15 user nova-compute[75703]:     </disk>
Nov 10 15:00:15 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:00:15 user nova-compute[75703]:       <mac address="fa:16:3e:d3:a6:c1"/>
Nov 10 15:00:15 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:00:15 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:00:15 user nova-compute[75703]:       <target dev="tap1a8f0f29-23"/>
Nov 10 15:00:15 user nova-compute[75703]:     </interface>
Nov 10 15:00:15 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:00:15 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/69cd5c16-a011-43e5-a7e1-273fd1e332b3/console.log" append="off"/>
Nov 10 15:00:15 user nova-compute[75703]:     </serial>
Nov 10 15:00:15 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:00:15 user nova-compute[75703]:     <video>
Nov 10 15:00:15 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:00:15 user nova-compute[75703]:     </video>
Nov 10 15:00:15 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:00:15 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:00:15 user nova-compute[75703]:     </rng>
Nov 10 15:00:15 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:00:15 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:00:15 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:00:15 user nova-compute[75703]:     </memballoon>
Nov 10 15:00:15 user nova-compute[75703]:   </devices>
Nov 10 15:00:15 user nova-compute[75703]: </domain>
Nov 10 15:00:15 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1326957089',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1326957089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1326957089',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsk3+aB4ff3xgjtO/jGm/gFET5Imi1Dl3h0TG0acAR7PMJKHMBT2cAGTm57Jq3DR3k+X7PRs68Z82OX/4WR43NjRqCUXQ/RZNWKJCxHqTSG8pD/L8SJ0qItX0zyYCE3+Q==',key_name='tempest-keypair-1844582802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-90tw4xjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=69cd5c16-a011-43e5-a7e1-273fd1e332b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG os_vif [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '714aa310-4fbe-5e3f-9ce4-890b748d7d64', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a8f0f29-23, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a8f0f29-23, col_values=(('qos', UUID('06962b0f-927d-4b36-b809-39477036c15d')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a8f0f29-23, col_values=(('external_ids', {'iface-id': '1a8f0f29-2317-44c0-b2c9-96b35b3aaeab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:a6:c1', 'vm-uuid': '69cd5c16-a011-43e5-a7e1-273fd1e332b3'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:15 user nova-compute[75703]: INFO os_vif [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23')
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:00:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No VIF found with MAC fa:16:3e:d3:a6:c1, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:00:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:00:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-151fc3b8-1200-4e3e-ab53-120353400d12 req-b5f7cc2c-0e16-49c0-86fd-3c509e100048 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-151fc3b8-1200-4e3e-ab53-120353400d12 req-b5f7cc2c-0e16-49c0-86fd-3c509e100048 service nova] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-151fc3b8-1200-4e3e-ab53-120353400d12 req-b5f7cc2c-0e16-49c0-86fd-3c509e100048 service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-151fc3b8-1200-4e3e-ab53-120353400d12 req-b5f7cc2c-0e16-49c0-86fd-3c509e100048 service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-151fc3b8-1200-4e3e-ab53-120353400d12 req-b5f7cc2c-0e16-49c0-86fd-3c509e100048 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] No waiting events found dispatching network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:17 user nova-compute[75703]: WARNING nova.compute.manager [req-151fc3b8-1200-4e3e-ab53-120353400d12 req-b5f7cc2c-0e16-49c0-86fd-3c509e100048 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received unexpected event network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab for instance with vm_state building and task_state spawning.
Nov 10 15:00:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:00:19 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Instance spawned successfully.
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-1660cb49-098a-430a-adbb-87860d573564 req-b4147881-9511-4150-952c-e34bc41d4ef3 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1660cb49-098a-430a-adbb-87860d573564 req-b4147881-9511-4150-952c-e34bc41d4ef3 service nova] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1660cb49-098a-430a-adbb-87860d573564 req-b4147881-9511-4150-952c-e34bc41d4ef3 service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1660cb49-098a-430a-adbb-87860d573564 req-b4147881-9511-4150-952c-e34bc41d4ef3 service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-1660cb49-098a-430a-adbb-87860d573564 req-b4147881-9511-4150-952c-e34bc41d4ef3 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] No waiting events found dispatching network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:19 user nova-compute[75703]: WARNING nova.compute.manager [req-1660cb49-098a-430a-adbb-87860d573564 req-b4147881-9511-4150-952c-e34bc41d4ef3 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received unexpected event network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab for instance with vm_state building and task_state spawning.
Nov 10 15:00:19 user nova-compute[75703]: INFO nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 10 15:00:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:00:19 user nova-compute[75703]: INFO nova.compute.manager [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Took 33.22 seconds to build instance.
Nov 10 15:00:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f182f490-76b9-4d45-8c05-cde99944cedd tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.575s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwfzhTRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:00:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:00:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:00:29 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[72922b48-0d74-486c-b9ba-2c32409f6664]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:00:29 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[214b01e8-93c3-4f5e-a74e-323881ccbcbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907] added
Nov 10 15:00:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96aa623-e121-4044-a7ff-3c1b7405f22b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9213cbc-5295-4dc5-b0df-f7ffdeb92a4c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwfzhTRr {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwfzhTRr" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9402a0-2fc5-4d80-89e5-038ae33c2c1c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qwfzhTRr'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c3efb-ab03-403f-9024-c123aebae0d5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.113s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab73d1-5d39-4c44-9118-01b90a5babd7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f6f15-4799-4b5a-b604-5a80532731c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260]
Nov 10 15:00:29 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260] successful.
Nov 10 15:00:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cceda2-4e2c-45f5-87c4-2a2d9ee31524]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2974faf4-5c1f-4c08-baf9-75bbb9a36fec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:00:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2e781-3dc5-4b0e-ad96-5f4303432cc4]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwfzhTRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '23137353565303937', 'path': '/dev/sde'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137353565303937', 'path': '/dev/sde'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:00:30 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:00:30 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 15:00:30 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:00:30 user nova-compute[75703]:   <serial>1034a57e-5df3-4842-adfd-5690d0cc3907</serial>
Nov 10 15:00:30 user nova-compute[75703]: </disk>
Nov 10 15:00:30 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:00:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No VIF found with MAC fa:16:3e:73:77:e2, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:00:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6bbb77fc-e583-49e6-8c92-651275157a46 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.005s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:37 user nova-compute[75703]: INFO nova.compute.manager [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Unrescuing
Nov 10 15:00:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:00:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquired lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:00:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updating instance_info_cache with network_info: [{"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Releasing lock "refresh_cache-e1842482-4120-40ff-843d-6395f6b14960" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'flavor' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:38 user nova-compute[75703]: INFO nova.compute.manager [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attaching volume 5a8237c8-2220-45ae-a9cc-4df9dd5ab132 to /dev/vdc
Nov 10 15:00:38 user nova-compute[75703]: DEBUG os_brick.utils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c199f60d-8018-4687-9a3b-19903683d150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9edf27-df4d-4107-860e-bd085772931d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f35e1a9-4654-4e34-9ab8-8da791530ff4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd6c1d5-6730-4972-bc7a-57c534b9aa0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:00:39 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:00:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[12677d6d-0330-451f-af29-4f5e9d10ee49]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG os_brick.utils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updating existing volume attachment record: 02808905-878a-4e03-9b90-7a1b23fca976 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-3fc3edb5-6f32-4cb1-b324-ae99129e4f73 req-4435ed93-fadd-47e4-ae70-a55104fbb8d3 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3fc3edb5-6f32-4cb1-b324-ae99129e4f73 req-4435ed93-fadd-47e4-ae70-a55104fbb8d3 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3fc3edb5-6f32-4cb1-b324-ae99129e4f73 req-4435ed93-fadd-47e4-ae70-a55104fbb8d3 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3fc3edb5-6f32-4cb1-b324-ae99129e4f73 req-4435ed93-fadd-47e4-ae70-a55104fbb8d3 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-3fc3edb5-6f32-4cb1-b324-ae99129e4f73 req-4435ed93-fadd-47e4-ae70-a55104fbb8d3 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:39 user nova-compute[75703]: WARNING nova.compute.manager [req-3fc3edb5-6f32-4cb1-b324-ae99129e4f73 req-4435ed93-fadd-47e4-ae70-a55104fbb8d3 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance destroyed successfully.
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:41 user nova-compute[75703]: WARNING nova.compute.manager [req-b0ab82d9-9121-42eb-b404-f2feec136e46 req-071fc45b-899d-48e8-a8b6-5190bac8b506 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:43 user nova-compute[75703]: WARNING nova.compute.manager [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:00:43 user nova-compute[75703]: WARNING nova.compute.manager [req-e9aca568-fb9b-4381-b189-817114138936 req-0ddc3f56-ef36-47c2-a227-5441fba1cff2 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:00:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5c4f2e0b-55df-48fc-a30b-7950e356d8c6 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:00:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Acquiring lock "d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Lock "d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:58 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:00:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:00:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:00:58 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:00:58 user nova-compute[75703]: INFO nova.compute.claims [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Claim successful on node user
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:00:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.policy [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69464503f47d4605a563e6b3edd81fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '323e4f32657441eaa1a4fc9e161e3d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:00:59 user nova-compute[75703]: INFO nova.virt.block_device [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Booting with volume 046fa267-8071-4380-b80d-9f611bcce2b4 at /dev/vda
Nov 10 15:00:59 user nova-compute[75703]: DEBUG os_brick.utils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d243de-fa08-4529-a5d0-62a8ccbbfac5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4568250-7abc-4138-b448-758670a8813f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde048d-935d-4a4a-bfd0-47a181973f0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b97c51b-5c23-45c0-8e8c-88a474f9dca6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:00:59 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:00:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26fab97-f75f-4579-a7bd-2cfb4bdc854d]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG os_brick.utils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:00:59 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Updating existing volume attachment record: 3b1f9996-1069-4302-8706-3737611e04cb {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:01:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Successfully created port: fbff4654-9cab-41c1-8b30-34751272d65c {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:01:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:00 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Successfully updated port: fbff4654-9cab-41c1-8b30-34751272d65c {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Acquiring lock "refresh_cache-d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Acquired lock "refresh_cache-d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Received event network-changed-fbff4654-9cab-41c1-8b30-34751272d65c {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Refreshing instance network info cache due to event network-changed-fbff4654-9cab-41c1-8b30-34751272d65c. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] Acquiring lock "refresh_cache-d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Updating instance_info_cache with network_info: [{"id": "fbff4654-9cab-41c1-8b30-34751272d65c", "address": "fa:16:3e:53:70:b2", "network": {"id": "212444eb-8238-4009-9a63-98d7a708ace8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1976725742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323e4f32657441eaa1a4fc9e161e3d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbff4654-9c", "ovs_interfaceid": "fbff4654-9cab-41c1-8b30-34751272d65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Releasing lock "refresh_cache-d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Instance network_info: |[{"id": "fbff4654-9cab-41c1-8b30-34751272d65c", "address": "fa:16:3e:53:70:b2", "network": {"id": "212444eb-8238-4009-9a63-98d7a708ace8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1976725742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323e4f32657441eaa1a4fc9e161e3d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbff4654-9c", "ovs_interfaceid": "fbff4654-9cab-41c1-8b30-34751272d65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] Acquired lock "refresh_cache-d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:01 user nova-compute[75703]: DEBUG nova.network.neutron [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Refreshing network info cache for port fbff4654-9cab-41c1-8b30-34751272d65c {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:01:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Updated VIF entry in instance network info cache for port fbff4654-9cab-41c1-8b30-34751272d65c. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:01:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Updating instance_info_cache with network_info: [{"id": "fbff4654-9cab-41c1-8b30-34751272d65c", "address": "fa:16:3e:53:70:b2", "network": {"id": "212444eb-8238-4009-9a63-98d7a708ace8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1976725742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323e4f32657441eaa1a4fc9e161e3d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbff4654-9c", "ovs_interfaceid": "fbff4654-9cab-41c1-8b30-34751272d65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c326c4da-baa2-4302-9896-7db3d05359d3 req-eaf10e21-f020-47a6-8d88-37ce4219fe79 service nova] Releasing lock "refresh_cache-d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbOltDdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:04 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:04 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:04 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae1411e-c4ac-4bc7-bbac-3cf8b2fc5656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:01:04 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa539900-5ffe-44e6-9f01-54e20b55430f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132] added
Nov 10 15:01:04 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5820bc-0a26-458f-bb66-71573cd6c8ac]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ba4ae-40bb-48d3-97d1-f9266e683856]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbOltDdF {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbOltDdF" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0473dc-74c6-48ce-a892-a4101d3c3161]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbOltDdF'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26a929-2e08-40b1-977d-ccc78da3da49]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[91648930-5376-437b-b9f0-90900cb1a9b5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34906c3-dae8-40e2-a978-c73deadc3a84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260]
Nov 10 15:01:05 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260] successful.
Nov 10 15:01:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3854e258-165e-47c4-adad-c849a4d0d7d8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaaa9b0-6b3f-4bbf-81f6-13d3a73ca436]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:05 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dddf303-5061-42c2-b7e3-ea2787327abb]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:01:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbOltDdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23065393363326532', 'path': '/dev/sdf'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065393363326532', 'path': '/dev/sdf'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.objects.instance [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:01:06 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:06 user nova-compute[75703]:   <source dev="/dev/sdf"/>
Nov 10 15:01:06 user nova-compute[75703]:   <target dev="vdc" bus="virtio"/>
Nov 10 15:01:06 user nova-compute[75703]:   <serial>5a8237c8-2220-45ae-a9cc-4df9dd5ab132</serial>
Nov 10 15:01:06 user nova-compute[75703]: </disk>
Nov 10 15:01:06 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Skipping network cache update for instance because it is Building. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] No VIF found with MAC fa:16:3e:73:77:e2, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-43745aa2-ba2f-4f40-ae7f-b4086626f55c tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.150s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [{"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-40c0bb3c-e83a-4d70-9299-a94c686cda28" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:08 user nova-compute[75703]: INFO nova.compute.manager [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Detaching volume 1034a57e-5df3-4842-adfd-5690d0cc3907
Nov 10 15:01:08 user nova-compute[75703]: INFO nova.virt.block_device [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attempting to driver detach volume 1034a57e-5df3-4842-adfd-5690d0cc3907 from mountpoint /dev/vdb
Nov 10 15:01:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Attempting to detach device vdb from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:01:08 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:08 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 15:01:08 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:01:08 user nova-compute[75703]:   <serial>1034a57e-5df3-4842-adfd-5690d0cc3907</serial>
Nov 10 15:01:08 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:01:08 user nova-compute[75703]: </disk>
Nov 10 15:01:08 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:01:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully detached device vdb from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the persistent domain config.
Nov 10 15:01:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:01:08 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:08 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 15:01:08 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:01:08 user nova-compute[75703]:   <serial>1034a57e-5df3-4842-adfd-5690d0cc3907</serial>
Nov 10 15:01:08 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:01:08 user nova-compute[75703]: </disk>
Nov 10 15:01:08 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing instance network info cache due to event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: INFO nova.compute.manager [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Terminating instance
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.objects.instance [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'flavor' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updated VIF entry in instance network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e00671b2-54ee-4f39-aba4-fd1b6cfc69ba req-62bbcdcd-a3c8-476a-8d24-2df3c7f73b63 service nova] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:10 user nova-compute[75703]: INFO nova.compute.manager [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Attaching volume c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 to /dev/vdb
Nov 10 15:01:10 user nova-compute[75703]: DEBUG os_brick.utils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f727172-8fe3-43f6-97ac-f867123fbaee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a086c327-815d-445d-8dbf-89ea8be2001d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc7a2e3-a209-417b-b756-d55bf625d78a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b29a8-379e-4096-a0e9-b46039fce46a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-1d5bed72-a1b5-4ef8-b8b0-96ebfabc1a61 req-e7e5173f-fb98-4357-8511-c7deddff2364 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-unplugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1d5bed72-a1b5-4ef8-b8b0-96ebfabc1a61 req-e7e5173f-fb98-4357-8511-c7deddff2364 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1d5bed72-a1b5-4ef8-b8b0-96ebfabc1a61 req-e7e5173f-fb98-4357-8511-c7deddff2364 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1d5bed72-a1b5-4ef8-b8b0-96ebfabc1a61 req-e7e5173f-fb98-4357-8511-c7deddff2364 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-1d5bed72-a1b5-4ef8-b8b0-96ebfabc1a61 req-e7e5173f-fb98-4357-8511-c7deddff2364 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-unplugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-1d5bed72-a1b5-4ef8-b8b0-96ebfabc1a61 req-e7e5173f-fb98-4357-8511-c7deddff2364 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-unplugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:01:10 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ac9f20-ea4d-4128-8284-9c58cb84a8aa]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG os_brick.utils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating existing volume attachment record: 8c530bde-002d-45ae-b036-2c1bb562ee12 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Instance destroyed successfully.
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lazy-loading 'resources' on Instance uuid 17ab0956-341f-4367-bbaa-4c84411d0b0b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-584580713',display_name='tempest-VolumesNegativeTest-instance-584580713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-584580713',id=33,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26adf4a92cac4e7bb607d3edbe30b087',ramdisk_id='',reservation_id='r-7ii577oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1029237373',owner_user_name='tempest-VolumesNegativeTest-1029237373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:59:28Z,user_data=None,user_id='cc195ba455c543f48890aabad053a51c',uuid=17ab0956-341f-4367-bbaa-4c84411d0b0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Converting VIF {"id": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "address": "fa:16:3e:c5:00:f4", "network": {"id": "c29c64b8-b607-4e8b-8371-9ea116e7f015", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bfc7ba0b28e846f994e6c3d465e1047d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eda7121-de", "ovs_interfaceid": "6eda7121-dea8-4797-a2cf-ad8c264a2369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG os_vif [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eda7121-de, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c85ebca4-e715-4a93-8e7e-c92385062da4) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: INFO os_vif [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=6eda7121-dea8-4797-a2cf-ad8c264a2369,network=Network(c29c64b8-b607-4e8b-8371-9ea116e7f015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eda7121-de')
Nov 10 15:01:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Deleting instance files /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b_del
Nov 10 15:01:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Deletion of /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b_del complete
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000021, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/17ab0956-341f-4367-bbaa-4c84411d0b0b/disk
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:11 user nova-compute[75703]: INFO nova.compute.manager [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9c518f7-9989-414b-99ea-f1bc451edef0 req-fa7fe56f-2859-422f-a748-74ed178ebfde service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-deleted-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:12 user nova-compute[75703]: INFO nova.compute.manager [req-b9c518f7-9989-414b-99ea-f1bc451edef0 req-fa7fe56f-2859-422f-a748-74ed178ebfde service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Neutron deleted interface 6eda7121-dea8-4797-a2cf-ad8c264a2369; detaching it from the instance and deleting it from the info cache
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9c518f7-9989-414b-99ea-f1bc451edef0 req-fa7fe56f-2859-422f-a748-74ed178ebfde service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=6897MB free_disk=24.690937042236328GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9c518f7-9989-414b-99ea-f1bc451edef0 req-fa7fe56f-2859-422f-a748-74ed178ebfde service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Detach interface failed, port_id=6eda7121-dea8-4797-a2cf-ad8c264a2369, reason: Instance 17ab0956-341f-4367-bbaa-4c84411d0b0b could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:01:12 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Took 0.97 seconds to deallocate network for instance.
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 29e60285-ce7c-4b88-b013-458e19039808 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 36a3590e-c24d-459e-8a32-6f13a4e10498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 17ab0956-341f-4367-bbaa-4c84411d0b0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a660d0a5-43a3-4ded-8176-316bf54c556a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fa433bf7-2318-4dce-b293-b3907a7ab390 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 69cd5c16-a011-43e5-a7e1-273fd1e332b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state deleted and task_state None.
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state deleted and task_state None.
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state deleted and task_state None.
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-unplugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-unplugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-unplugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state deleted and task_state None.
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Acquiring lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] No waiting events found dispatching network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:12 user nova-compute[75703]: WARNING nova.compute.manager [req-b07ff4f6-5d22-4808-ae5a-23d002a0d87b req-ac20943e-6bdc-413d-9eb5-042c2cf27a27 service nova] [instance: 17ab0956-341f-4367-bbaa-4c84411d0b0b] Received unexpected event network-vif-plugged-6eda7121-dea8-4797-a2cf-ad8c264a2369 for instance with vm_state deleted and task_state None.
Nov 10 15:01:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.681s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:01:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:13 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Deleted allocations for instance 17ab0956-341f-4367-bbaa-4c84411d0b0b
Nov 10 15:01:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a90da6d-ca99-4f91-b181-403a01dbf686 tempest-VolumesNegativeTest-1029237373 tempest-VolumesNegativeTest-1029237373-project-member] Lock "17ab0956-341f-4367-bbaa-4c84411d0b0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.704s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-changed-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Refreshing instance network info cache due to event network-changed-11e5b42e-cf66-4a9e-88b7-818c7c13bee5. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Refreshing network info cache for port 11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updated VIF entry in instance network info cache for port 11e5b42e-cf66-4a9e-88b7-818c7c13bee5. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-946ba524-ca0b-417c-9dba-208827ca40ce req-32d02b81-e800-4408-ad50-c1a0ecfe3e6f service nova] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Stashing vm_state: active {{(pid=75703) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:01:16 user nova-compute[75703]: INFO nova.compute.claims [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Claim successful on node user
Nov 10 15:01:16 user nova-compute[75703]: INFO nova.compute.resource_tracker [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating resource usage from migration b3579598-1730-46d1-bba9-ba13ad950458
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-changed-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Refreshing instance network info cache due to event network-changed-76e9185b-15b2-42d6-a80f-b57c6d226695. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] Acquiring lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] Acquired lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Refreshing network info cache for port 76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:01:16 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updated VIF entry in instance network info cache for port 76e9185b-15b2-42d6-a80f-b57c6d226695. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.network.neutron [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.604s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:17 user nova-compute[75703]: INFO nova.compute.manager [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Migrating
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-18097f72-69bd-4f97-ad3b-77986aeb4873 req-60794198-6188-4fde-91f4-b649dd262a05 service nova] Releasing lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquired lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Releasing lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Starting migrate_disk_and_power_off {{(pid=75703) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-afcb3a9d-bf6d-46b8-9631-7b1e845dee67 req-88bfc5fd-4731-4ae6-ac34-1f2ffa299fc5 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-unplugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-afcb3a9d-bf6d-46b8-9631-7b1e845dee67 req-88bfc5fd-4731-4ae6-ac34-1f2ffa299fc5 service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-afcb3a9d-bf6d-46b8-9631-7b1e845dee67 req-88bfc5fd-4731-4ae6-ac34-1f2ffa299fc5 service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-afcb3a9d-bf6d-46b8-9631-7b1e845dee67 req-88bfc5fd-4731-4ae6-ac34-1f2ffa299fc5 service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-afcb3a9d-bf6d-46b8-9631-7b1e845dee67 req-88bfc5fd-4731-4ae6-ac34-1f2ffa299fc5 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-unplugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:17 user nova-compute[75703]: WARNING nova.compute.manager [req-afcb3a9d-bf6d-46b8-9631-7b1e845dee67 req-88bfc5fd-4731-4ae6-ac34-1f2ffa299fc5 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-unplugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state active and task_state resize_migrating.
Nov 10 15:01:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:18 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance destroyed successfully.
Nov 10 15:01:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2099456931',display_name='tempest-ServerActionsTestOtherA-server-2099456931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2099456931',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-fcv3dmop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=a660d0a5-43a3-4ded-8176-316bf54c556a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76e9185b-15, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=848feed6-3101-4493-be78-d95d03fa42e0) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:18 user nova-compute[75703]: INFO os_vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15')
Nov 10 15:01:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:18 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8c531-8ef8-46af-94e1-66b58fd98463]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:01:18 user nova-compute[75703]: No targets found.
Nov 10 15:01:18 user nova-compute[75703]: iSNS:
Nov 10 15:01:18 user nova-compute[75703]: No targets found.
Nov 10 15:01:18 user nova-compute[75703]: STATIC:
Nov 10 15:01:18 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:01:18 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:18 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:18 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 15:01:18 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:18 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:18 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132
Nov 10 15:01:18 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:18 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:18 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:01:18 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:18 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:18 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 15:01:18 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:18 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:18 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907
Nov 10 15:01:18 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:18 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:18 user nova-compute[75703]: FIRMWARE:
Nov 10 15:01:18 user nova-compute[75703]: No targets found.
Nov 10 15:01:18 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:01:18 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:01:18 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1606d4-4963-483a-8758-f7d32f73c300]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[70663dc4-00ae-4a0d-ba26-8614c157eebb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:18 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480e05c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca320d0-1c28-4d84-9202-d6a445e3b00a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71a33c2-883e-4819-957d-fef1b8ebb4f2]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[52034a3b-d435-4369-82cc-30ed4aea0ba9]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[582064b7-32b1-4e7e-a59f-ae09634eaaa7]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[27281aec-d64c-46c5-b52b-5e1c94546ae6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bec92f-1b24-486d-9dae-1467b46aa28f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]
Nov 10 15:01:18 user nova-compute[75703]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.
Nov 10 15:01:18 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aedaa1f-379f-46da-a6bb-944a44bf0845]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== disconnect_volume: return (366ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:01:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Port 76e9185b-15b2-42d6-a80f-b57c6d226695 binding to destination host user is already ACTIVE {{(pid=75703) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-fffc095b-5fbd-41b9-b76a-09c853354db9 req-63b5af12-b5d7-4847-ad92-8d38a1100805 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fffc095b-5fbd-41b9-b76a-09c853354db9 req-63b5af12-b5d7-4847-ad92-8d38a1100805 service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fffc095b-5fbd-41b9-b76a-09c853354db9 req-63b5af12-b5d7-4847-ad92-8d38a1100805 service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fffc095b-5fbd-41b9-b76a-09c853354db9 req-63b5af12-b5d7-4847-ad92-8d38a1100805 service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-fffc095b-5fbd-41b9-b76a-09c853354db9 req-63b5af12-b5d7-4847-ad92-8d38a1100805 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:19 user nova-compute[75703]: WARNING nova.compute.manager [req-fffc095b-5fbd-41b9-b76a-09c853354db9 req-63b5af12-b5d7-4847-ad92-8d38a1100805 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state active and task_state resize_migrating.
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquired lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.volume.cinder [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Update attachment failed for attachment 3b1f9996-1069-4302-8706-3737611e04cb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Traceback (most recent call last):
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     driver_block_device.attach_block_devices(
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     _log_and_attach(device)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     self._do_attach(context, instance, volume, volume_api,
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     self._volume_attach(context, volume, connector, instance,
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     connection_info = volume_api.attachment_update(
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     res = method(self, ctx, *args, **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     with excutils.save_and_reraise_exception():
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     self.force_reraise()
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     raise self.value
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     return method.func(obj, *args, **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     resp = self._update('/attachments/%s' % id, body)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     return self.request(url, method, **kwargs)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d]     raise exceptions.from_response(resp, body)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2)
Nov 10 15:01:20 user nova-compute[75703]: ERROR nova.compute.manager [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] 
Nov 10 15:01:20 user nova-compute[75703]: DEBUG nova.compute.claims [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Aborting claim: <nova.compute.claims.Claim object at 0x7fb4c427e740> {{(pid=75703) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Releasing lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG os_brick.utils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d604ea-80e1-4b3b-b0d7-69fa9f457b66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3eb89-82a0-49dc-92d1-4883f7a85381]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336f319-ca5e-4f97-be7e-a66e5541f9c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70d24d-e76f-4099-9d65-4b8013144b41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:01:20 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:01:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b5b1a0-fc5a-4309-aca0-7a53aac64a88]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG os_brick.utils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:01:20 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.570s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Build of instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2) {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.utils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Build of instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75703) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 15:01:21 user nova-compute[75703]: ERROR nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Build of instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2): nova.exception.BuildAbortException: Build of instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2)
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Unplugging VIFs for instance {{(pid=75703) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-546002605',display_name='tempest-TestShelveInstance-server-546002605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-546002605',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgajHvGeKb8JMS4TMMW8/tWxDOnAPLv47IXBQexiAuFen9aRblS/PfxmG1LEJQxZ8ElRYlYe2OHY5bgUeBg2F8mTuHKngs76OrTQnM5Zai5SDp+CBr0yJblHnLROQrTyA==',key_name='tempest-TestShelveInstance-1201722402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='323e4f32657441eaa1a4fc9e161e3d1e',ramdisk_id='',reservation_id='r-okirz8qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1140172474',owner_user_name='tempest-TestShelveInstance-1140172474-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:00:59Z,user_data=None,user_id='69464503f47d4605a563e6b3edd81fad',uuid=d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbff4654-9cab-41c1-8b30-34751272d65c", "address": "fa:16:3e:53:70:b2", "network": {"id": "212444eb-8238-4009-9a63-98d7a708ace8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1976725742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323e4f32657441eaa1a4fc9e161e3d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbff4654-9c", "ovs_interfaceid": "fbff4654-9cab-41c1-8b30-34751272d65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Converting VIF {"id": "fbff4654-9cab-41c1-8b30-34751272d65c", "address": "fa:16:3e:53:70:b2", "network": {"id": "212444eb-8238-4009-9a63-98d7a708ace8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1976725742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "323e4f32657441eaa1a4fc9e161e3d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbff4654-9c", "ovs_interfaceid": "fbff4654-9cab-41c1-8b30-34751272d65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=fbff4654-9cab-41c1-8b30-34751272d65c,network=Network(212444eb-8238-4009-9a63-98d7a708ace8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbff4654-9c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG os_vif [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=fbff4654-9cab-41c1-8b30-34751272d65c,network=Network(212444eb-8238-4009-9a63-98d7a708ace8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbff4654-9c') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbff4654-9c, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:01:21 user nova-compute[75703]: INFO os_vif [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:b2,bridge_name='br-int',has_traffic_filtering=True,id=fbff4654-9cab-41c1-8b30-34751272d65c,network=Network(212444eb-8238-4009-9a63-98d7a708ace8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbff4654-9c')
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Unplugged VIFs for instance {{(pid=75703) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:21 user nova-compute[75703]: INFO nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Took 0.51 seconds to deallocate network for instance.
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Detaching volume: 046fa267-8071-4380-b80d-9f611bcce2b4 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 15:01:21 user nova-compute[75703]: INFO nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Detaching volume 046fa267-8071-4380-b80d-9f611bcce2b4
Nov 10 15:01:21 user nova-compute[75703]: ERROR nova.virt.block_device [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Unable to call for a driver detach of volume 046fa267-8071-4380-b80d-9f611bcce2b4 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a738ac6b-b5a9-458f-9f2f-e9b9c62256e2)
Nov 10 15:01:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] [instance: d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d] Deleting volume: 046fa267-8071-4380-b80d-9f611bcce2b4 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 15:01:22 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Deleted allocations for instance d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d
Nov 10 15:01:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0fae207b-1e34-4a29-b48d-d51357aac65a tempest-TestShelveInstance-1140172474 tempest-TestShelveInstance-1140172474-project-member] Lock "d21f8a92-79a3-4cb0-b5bd-1fd12e53b40d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.547s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 is timed out.
Nov 10 15:01:29 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully detached device vdb from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the live domain config.
Nov 10 15:01:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwfzhTRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e67eb4-1ed1-4d49-b7ef-17107d2288ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:01:29 user nova-compute[75703]: No targets found.
Nov 10 15:01:29 user nova-compute[75703]: iSNS:
Nov 10 15:01:29 user nova-compute[75703]: No targets found.
Nov 10 15:01:29 user nova-compute[75703]: STATIC:
Nov 10 15:01:29 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 15:01:29 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:29 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:29 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132
Nov 10 15:01:29 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:29 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:29 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:01:29 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:29 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:29 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 15:01:29 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:29 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:29 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907
Nov 10 15:01:29 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:29 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:29 user nova-compute[75703]: FIRMWARE:
Nov 10 15:01:29 user nova-compute[75703]: No targets found.
Nov 10 15:01:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:01:29 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:01:29 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868eac0-95e5-4d4e-a27f-ff73bf56bb84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324c1f8-7cb3-4fcc-bd30-ef482dd2d9a2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a429e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907'): ({'sde'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Removing single pathed devices sde {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb33a0-ef64-41fc-bcc3-4502e6ca5d97]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e4f2b0-e796-41ec-9db3-63dc9b14d9cc]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Flushing IO for device /dev/sde {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89b97d-1a95-4594-94c5-6b3efa8d6644]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[391277e5-aa61-414e-81ed-16bead56bd77]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af8616d-b88e-4c02-b004-30e72dc2298a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1d6856-096a-482a-8635-b09b20e731a5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260]
Nov 10 15:01:29 user nova-compute[75703]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907, portal: 172.16.0.220,3260] successful.
Nov 10 15:01:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1034a57e-5df3-4842-adfd-5690d0cc3907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395a8ed-692c-49cd-886b-ca7deba7c7d5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== disconnect_volume: return (330ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:01:30 user nova-compute[75703]: DEBUG nova.objects.instance [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-31cbdae1-c79e-4077-95d8-8ea5171cbf64 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.123s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:31 user nova-compute[75703]: INFO nova.compute.manager [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Detaching volume 5a8237c8-2220-45ae-a9cc-4df9dd5ab132
Nov 10 15:01:31 user nova-compute[75703]: INFO nova.virt.block_device [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Attempting to driver detach volume 5a8237c8-2220-45ae-a9cc-4df9dd5ab132 from mountpoint /dev/vdc
Nov 10 15:01:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Attempting to detach device vdc from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:01:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:01:31 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:31 user nova-compute[75703]:   <source dev="/dev/sdf"/>
Nov 10 15:01:31 user nova-compute[75703]:   <target dev="vdc" bus="virtio"/>
Nov 10 15:01:31 user nova-compute[75703]:   <serial>5a8237c8-2220-45ae-a9cc-4df9dd5ab132</serial>
Nov 10 15:01:31 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 15:01:31 user nova-compute[75703]: </disk>
Nov 10 15:01:31 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:01:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully detached device vdc from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the persistent domain config.
Nov 10 15:01:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:01:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:01:31 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:31 user nova-compute[75703]:   <source dev="/dev/sdf"/>
Nov 10 15:01:31 user nova-compute[75703]:   <target dev="vdc" bus="virtio"/>
Nov 10 15:01:31 user nova-compute[75703]:   <serial>5a8237c8-2220-45ae-a9cc-4df9dd5ab132</serial>
Nov 10 15:01:31 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 15:01:31 user nova-compute[75703]: </disk>
Nov 10 15:01:31 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:01:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:01:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:01:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:01:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:01:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-changed-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Refreshing instance network info cache due to event network-changed-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:01:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] Acquiring lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] Acquired lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:36 user nova-compute[75703]: DEBUG nova.network.neutron [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Refreshing network info cache for port 1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPJMACbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:37 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[98355bcf-b05b-4e82-ab92-dcf6757c0dfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:01:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c9bf81-66cf-47a1-84db-15ceadd1d677]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6] added
Nov 10 15:01:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[51abf57f-eb48-4251-9417-0e7736c13341]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b80121-434a-4756-9182-d22acb6563d1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPJMACbc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPJMACbc" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1455e4-b831-4ee9-b7c2-9685bce49e44]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPJMACbc'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f992e3-99fd-4574-a346-3bf79d8b098b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc28fc-d2df-4768-8223-4088feff3b1c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updated VIF entry in instance network info cache for port 1a8f0f29-2317-44c0-b2c9-96b35b3aaeab. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updating instance_info_cache with network_info: [{"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e1b24632-44b9-4c2b-8ec7-3a7df363b907 req-4eafbf15-96eb-43d0-b8c7-37945a356242 service nova] Releasing lock "refresh_cache-69cd5c16-a011-43e5-a7e1-273fd1e332b3" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaf9776-f4e6-420a-90af-8880d6aa3b27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260]
Nov 10 15:01:37 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260] successful.
Nov 10 15:01:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabed0fa-41f9-4481-921a-9fe571cc2274]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eabc43-e81f-4a1a-a337-e980838b78e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[886cef57-d78c-4295-a469-970dbc5fea35]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:01:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPJMACbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26432366130643132', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432366130643132', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'flavor' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:01:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:38 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:01:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:01:38 user nova-compute[75703]:   <serial>c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6</serial>
Nov 10 15:01:38 user nova-compute[75703]: </disk>
Nov 10 15:01:38 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:00:c8:85, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:01:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7430eb7e-0418-4c97-9dea-8eecd8a76ec8 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.591s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:39 user nova-compute[75703]: INFO nova.compute.manager [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Rescuing
Nov 10 15:01:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:39 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:01:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG nova.network.neutron [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-671e5669-6189-43b5-adce-9c4b1037a35d req-b2a006c6-d7a2-4503-8b63-2ddff96c964e service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-671e5669-6189-43b5-adce-9c4b1037a35d req-b2a006c6-d7a2-4503-8b63-2ddff96c964e service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-671e5669-6189-43b5-adce-9c4b1037a35d req-b2a006c6-d7a2-4503-8b63-2ddff96c964e service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-671e5669-6189-43b5-adce-9c4b1037a35d req-b2a006c6-d7a2-4503-8b63-2ddff96c964e service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-671e5669-6189-43b5-adce-9c4b1037a35d req-b2a006c6-d7a2-4503-8b63-2ddff96c964e service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:40 user nova-compute[75703]: WARNING nova.compute.manager [req-671e5669-6189-43b5-adce-9c4b1037a35d req-b2a006c6-d7a2-4503-8b63-2ddff96c964e service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state active and task_state rescuing.
Nov 10 15:01:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance destroyed successfully.
Nov 10 15:01:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Attempting rescue
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75703) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 15:01:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Creating image(s)
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.249s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue" returned: 0 in 0.270s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.528s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'migration_context' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.base [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<b2a88db7-fb55-4fea-b1eb-b3550a8b3000> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Start _get_guest_xml network_info=[{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:00:c8:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'resources' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.base [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<b2a88db7-fb55-4fea-b1eb-b3550a8b3000> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'numa_topology' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.base [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<b2a88db7-fb55-4fea-b1eb-b3550a8b3000> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:01:41 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:01:41 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.base [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<b2a88db7-fb55-4fea-b1eb-b3550a8b3000> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2033951572',display_name='tempest-ServerRescueNegativeTestJSON-server-2033951572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2033951572',id=32,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwrLMbJcntOzGAehkzazcvpfUoRQDHzTSvqbBpVmgdiRUE6OVIDvi4D6P4wplVbIfblCWp6TcYTE9WI0uNMtZj4CyCCGXODKrPYHowANO1Ca63O0oj8e+1JgCv1jxCWqg==',key_name='tempest-keypair-108299880',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-50ne7ebz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T14:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=b2a88db7-fb55-4fea-b1eb-b3550a8b3000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:00:c8:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "vif_mac": "fa:16:3e:00:c8:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'pci_devices' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.objects.base [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Object Instance<b2a88db7-fb55-4fea-b1eb-b3550a8b3000> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:01:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:01:41 user nova-compute[75703]:   <uuid>b2a88db7-fb55-4fea-b1eb-b3550a8b3000</uuid>
Nov 10 15:01:41 user nova-compute[75703]:   <name>instance-00000020</name>
Nov 10 15:01:41 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:01:41 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:01:41 user nova-compute[75703]:   <metadata>
Nov 10 15:01:41 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:01:41 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:01:41 user nova-compute[75703]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2033951572</nova:name>
Nov 10 15:01:41 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:01:41</nova:creationTime>
Nov 10 15:01:41 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:01:41 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:01:41 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:01:41 user nova-compute[75703]:       <nova:owner>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:user uuid="6b7b8488f5964719b7b47ac4416c59ea">tempest-ServerRescueNegativeTestJSON-1926780524-project-member</nova:user>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:project uuid="5703fd918f4547218ac7ef97d6b1bbdc">tempest-ServerRescueNegativeTestJSON-1926780524</nova:project>
Nov 10 15:01:41 user nova-compute[75703]:       </nova:owner>
Nov 10 15:01:41 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:01:41 user nova-compute[75703]:       <nova:ports>
Nov 10 15:01:41 user nova-compute[75703]:         <nova:port uuid="3e6b5d1a-ff60-4a01-928b-e3ce75ec6875">
Nov 10 15:01:41 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 15:01:41 user nova-compute[75703]:         </nova:port>
Nov 10 15:01:41 user nova-compute[75703]:       </nova:ports>
Nov 10 15:01:41 user nova-compute[75703]:     </nova:instance>
Nov 10 15:01:41 user nova-compute[75703]:   </metadata>
Nov 10 15:01:41 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:01:41 user nova-compute[75703]:     <system>
Nov 10 15:01:41 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:01:41 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:01:41 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:01:41 user nova-compute[75703]:       <entry name="serial">b2a88db7-fb55-4fea-b1eb-b3550a8b3000</entry>
Nov 10 15:01:41 user nova-compute[75703]:       <entry name="uuid">b2a88db7-fb55-4fea-b1eb-b3550a8b3000</entry>
Nov 10 15:01:41 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:01:41 user nova-compute[75703]:     </system>
Nov 10 15:01:41 user nova-compute[75703]:   </sysinfo>
Nov 10 15:01:41 user nova-compute[75703]:   <os>
Nov 10 15:01:41 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:01:41 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:01:41 user nova-compute[75703]:   </os>
Nov 10 15:01:41 user nova-compute[75703]:   <features>
Nov 10 15:01:41 user nova-compute[75703]:     <acpi/>
Nov 10 15:01:41 user nova-compute[75703]:     <apic/>
Nov 10 15:01:41 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:01:41 user nova-compute[75703]:   </features>
Nov 10 15:01:41 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:01:41 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:01:41 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:01:41 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:01:41 user nova-compute[75703]:   </clock>
Nov 10 15:01:41 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:01:41 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:01:41 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:01:41 user nova-compute[75703]:   </cpu>
Nov 10 15:01:41 user nova-compute[75703]:   <devices>
Nov 10 15:01:41 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:01:41 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:01:41 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue"/>
Nov 10 15:01:41 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:01:41 user nova-compute[75703]:     </disk>
Nov 10 15:01:41 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:01:41 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:01:41 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk"/>
Nov 10 15:01:41 user nova-compute[75703]:       <target dev="vdb" bus="virtio"/>
Nov 10 15:01:41 user nova-compute[75703]:     </disk>
Nov 10 15:01:41 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:01:41 user nova-compute[75703]:       <mac address="fa:16:3e:00:c8:85"/>
Nov 10 15:01:41 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:01:41 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:01:41 user nova-compute[75703]:       <target dev="tap3e6b5d1a-ff"/>
Nov 10 15:01:41 user nova-compute[75703]:     </interface>
Nov 10 15:01:41 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:01:41 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/console.log" append="off"/>
Nov 10 15:01:41 user nova-compute[75703]:     </serial>
Nov 10 15:01:41 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:01:41 user nova-compute[75703]:     <video>
Nov 10 15:01:41 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:01:41 user nova-compute[75703]:     </video>
Nov 10 15:01:41 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:01:41 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:01:41 user nova-compute[75703]:     </rng>
Nov 10 15:01:41 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:01:41 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:01:41 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:01:41 user nova-compute[75703]:     </memballoon>
Nov 10 15:01:41 user nova-compute[75703]:   </devices>
Nov 10 15:01:41 user nova-compute[75703]: </domain>
Nov 10 15:01:41 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:01:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance destroyed successfully.
Nov 10 15:01:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] No VIF found with MAC fa:16:3e:00:c8:85, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-f65863ab-b3bc-4d0b-8126-5676f3997ce9 req-fcd02bb2-59e4-400f-9c3f-1142cbef99c8 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f65863ab-b3bc-4d0b-8126-5676f3997ce9 req-fcd02bb2-59e4-400f-9c3f-1142cbef99c8 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f65863ab-b3bc-4d0b-8126-5676f3997ce9 req-fcd02bb2-59e4-400f-9c3f-1142cbef99c8 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f65863ab-b3bc-4d0b-8126-5676f3997ce9 req-fcd02bb2-59e4-400f-9c3f-1142cbef99c8 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-f65863ab-b3bc-4d0b-8126-5676f3997ce9 req-fcd02bb2-59e4-400f-9c3f-1142cbef99c8 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:42 user nova-compute[75703]: WARNING nova.compute.manager [req-f65863ab-b3bc-4d0b-8126-5676f3997ce9 req-fcd02bb2-59e4-400f-9c3f-1142cbef99c8 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state active and task_state rescuing.
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:44 user nova-compute[75703]: WARNING nova.compute.manager [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state active and task_state rescuing.
Nov 10 15:01:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:44 user nova-compute[75703]: WARNING nova.compute.manager [req-c6eea8c5-21b8-4ee1-859b-fb7b3c558370 req-c63365e0-2d78-4a67-9eb2-47a5d9895347 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state active and task_state rescuing.
Nov 10 15:01:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0938b6b4-f906-45bd-a4ff-8771af3dcc6a tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:01:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 is timed out.
Nov 10 15:01:51 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully detached device vdc from instance 36a3590e-c24d-459e-8a32-6f13a4e10498 from the live domain config.
Nov 10 15:01:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbOltDdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:51 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef4a11-9e5e-4214-885c-715cfe27f29a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:01:51 user nova-compute[75703]: No targets found.
Nov 10 15:01:51 user nova-compute[75703]: iSNS:
Nov 10 15:01:51 user nova-compute[75703]: No targets found.
Nov 10 15:01:51 user nova-compute[75703]: STATIC:
Nov 10 15:01:51 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:01:51 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:51 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:51 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 15:01:51 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:51 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:51 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132
Nov 10 15:01:51 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:51 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:51 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:01:51 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:51 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:51 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 15:01:51 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:01:51 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:01:51 user nova-compute[75703]: FIRMWARE:
Nov 10 15:01:51 user nova-compute[75703]: No targets found.
Nov 10 15:01:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:01:51 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:01:51 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[451cf6e4-bfda-4d8b-a38f-d73cfc4b4000]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[685bfb45-d6da-4c22-ba2d-d1318c8e53f9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fbd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132'): ({'sdf'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Removing single pathed devices sdf {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeb1be1-4899-4905-a60f-1eb10bc74e4f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58e7387-cc8e-4392-8a59-91c372cde503]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Flushing IO for device /dev/sdf {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b910fc05-d1d2-4ed3-872c-6c3bc20a093d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d849b840-e1bb-4334-90dc-2f08d1c241fc]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] SCSI volumes sdf have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d410d-e30e-433e-9d17-d470233d6d4f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c77fdd4-8245-4b73-83c1-5fa18f6f9820]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260]
Nov 10 15:01:51 user nova-compute[75703]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132, portal: 172.16.0.220,3260] successful.
Nov 10 15:01:51 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a8237c8-2220-45ae-a9cc-4df9dd5ab132 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bec1d-6dcf-48a0-b038-70ddc40af9a6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] <== disconnect_volume: return (367ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:01:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:52 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'flavor' on Instance uuid fa433bf7-2318-4dce-b293-b3907a7ab390 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:52 user nova-compute[75703]: INFO nova.compute.manager [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Attaching volume 8f1fdb91-85a2-49f6-a498-920332f93575 to /dev/vdb
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.utils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc9da0-0b20-43eb-a81a-ae56dd2365d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[101283ef-02c4-48f8-b84f-82551b7659a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b15e27-b66d-4c18-846c-d6c8892d5587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843bb9c-6709-470a-b891-0e251e48967e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:01:53 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc127f6-fbc2-45e6-938f-1a3b82ccf77a]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.utils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating existing volume attachment record: 23260317-0f37-4bef-9197-035fed532201 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'flavor' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e74c504e-b4cb-42e5-a16b-617604ddb938 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.489s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Starting finish_migration {{(pid=75703) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance directory exists: not creating {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 15:01:53 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Creating image(s)
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Ensure instance console log exists: /opt/stack/data/nova/instances/a660d0a5-43a3-4ded-8176-316bf54c556a/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Start _get_guest_xml network_info=[{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '2c1dca63-5b4e-4cff-8c0a-388a7991e09d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a660d0a5-43a3-4ded-8176-316bf54c556a', 'attached_at': '2023-11-10T15:01:53.000000', 'detached_at': '', 'volume_id': 'a5a52271-1341-407f-996d-95c580acc6b4', 'serial': 'a5a52271-1341-407f-996d-95c580acc6b4'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:01:53 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:01:53 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:01:53 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:53 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:01:53 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a8e18a-3ba4-4a8e-b6a7-673de492f979]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:01:53 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc10267-2d94-47bd-b31d-a9221d11dcb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4] added
Nov 10 15:01:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a30323-6358-468d-b02b-0c09f8292371]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0070f525-661c-43ec-8adf-b9d77dca1c91]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrTIqMny {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrTIqMny" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[624067ac-87f0-43b3-aa60-202e6dafb40c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrTIqMny'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc1535-6eb3-4517-a210-cccd1d1d9bc9]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[91709060-6edc-498e-9bef-7c03ccb24f57]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:53 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:53 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:53 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:53 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:53 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:53 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:53 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:53 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94e3d4a-755b-4448-8f73-0a8355dc289d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]
Nov 10 15:01:54 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.
Nov 10 15:01:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af1fd6-7cdb-4e4b-b16c-8733ca723eef]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:01:54 user nova-compute[75703]: INFO nova.compute.claims [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Claim successful on node user
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ab1f1-9cdd-4dbe-9e38-671b5f9869cf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:01:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4298e43-7ccb-4886-93b9-7039cf941376]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:54 user nova-compute[75703]: INFO nova.compute.manager [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Terminating instance
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-5fe8e82e-98b5-4f28-ba3a-728a85fe4832 req-d2423ee6-525e-4a7d-8a66-dc333880b44a service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-vif-unplugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5fe8e82e-98b5-4f28-ba3a-728a85fe4832 req-d2423ee6-525e-4a7d-8a66-dc333880b44a service nova] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5fe8e82e-98b5-4f28-ba3a-728a85fe4832 req-d2423ee6-525e-4a7d-8a66-dc333880b44a service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5fe8e82e-98b5-4f28-ba3a-728a85fe4832 req-d2423ee6-525e-4a7d-8a66-dc333880b44a service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-5fe8e82e-98b5-4f28-ba3a-728a85fe4832 req-d2423ee6-525e-4a7d-8a66-dc333880b44a service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] No waiting events found dispatching network-vif-unplugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.compute.manager [req-5fe8e82e-98b5-4f28-ba3a-728a85fe4832 req-d2423ee6-525e-4a7d-8a66-dc333880b44a service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-vif-unplugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.910s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:01:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:01:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Instance destroyed successfully.
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.objects.instance [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lazy-loading 'resources' on Instance uuid 36a3590e-c24d-459e-8a32-6f13a4e10498 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1823796245',display_name='tempest-AttachVolumeTestJSON-server-1823796245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1823796245',id=31,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxLdSPkLxPdE7Ox0glF5vdNe/5mGyRQV4Ha0XO+dGnCFE+KuVGFF2jkAP7gR4w7RF+Pw3LjVU/8U+6SGf4zdz5S+Aa0HHFlOrPGLLi1ua1GZNMz7f9JlW2oruOfbOT5xg==',key_name='tempest-keypair-1965700923',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d17d344f86f40bcbb293bcb8dc06fb3',ramdisk_id='',reservation_id='r-zarqai03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1704980195',owner_user_name='tempest-AttachVolumeTestJSON-1704980195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12a92500f85a405fabde541ca2f18a05',uuid=36a3590e-c24d-459e-8a32-6f13a4e10498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converting VIF {"id": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "address": "fa:16:3e:73:77:e2", "network": {"id": "26b615c6-8f78-41c3-8e8a-7e5dd44bf929", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2098131287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d17d344f86f40bcbb293bcb8dc06fb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c05ad70-1d", "ovs_interfaceid": "2c05ad70-1d8d-43d9-a952-7d58ca951a8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG os_vif [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c05ad70-1d, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=873bcfe1-b4f7-459f-96ba-7d77d6dc3cf1) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:55 user nova-compute[75703]: INFO os_vif [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:77:e2,bridge_name='br-int',has_traffic_filtering=True,id=2c05ad70-1d8d-43d9-a952-7d58ca951a8b,network=Network(26b615c6-8f78-41c3-8e8a-7e5dd44bf929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c05ad70-1d')
Nov 10 15:01:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Deleting instance files /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498_del
Nov 10 15:01:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Deletion of /opt/stack/data/nova/instances/36a3590e-c24d-459e-8a32-6f13a4e10498_del complete
Nov 10 15:01:55 user nova-compute[75703]: INFO nova.virt.block_device [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Booting with volume snapshot 455c4804-fc8e-4929-bf51-d6c5cfa72743 at /dev/vda
Nov 10 15:01:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26462353565643064', 'path': '/dev/sde'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462353565643064', 'path': '/dev/sde'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2099456931',display_name='tempest-ServerActionsTestOtherA-server-2099456931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2099456931',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-fcv3dmop',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=a660d0a5-43a3-4ded-8176-316bf54c556a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:01:55 user nova-compute[75703]:   <uuid>a660d0a5-43a3-4ded-8176-316bf54c556a</uuid>
Nov 10 15:01:55 user nova-compute[75703]:   <name>instance-00000022</name>
Nov 10 15:01:55 user nova-compute[75703]:   <memory>2097152</memory>
Nov 10 15:01:55 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:01:55 user nova-compute[75703]:   <metadata>
Nov 10 15:01:55 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:01:55 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:01:55 user nova-compute[75703]:       <nova:name>tempest-ServerActionsTestOtherA-server-2099456931</nova:name>
Nov 10 15:01:55 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:01:53</nova:creationTime>
Nov 10 15:01:55 user nova-compute[75703]:       <nova:flavor name="m1.small">
Nov 10 15:01:55 user nova-compute[75703]:         <nova:memory>2048</nova:memory>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:disk>20</nova:disk>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:01:55 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:01:55 user nova-compute[75703]:       <nova:owner>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:user uuid="23ee54b16d604b829f2088d8e850c48c">tempest-ServerActionsTestOtherA-1989770067-project-member</nova:user>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:project uuid="37ddb2fd8ebd40b0bee398bd9969a0ee">tempest-ServerActionsTestOtherA-1989770067</nova:project>
Nov 10 15:01:55 user nova-compute[75703]:       </nova:owner>
Nov 10 15:01:55 user nova-compute[75703]:       <nova:ports>
Nov 10 15:01:55 user nova-compute[75703]:         <nova:port uuid="76e9185b-15b2-42d6-a80f-b57c6d226695">
Nov 10 15:01:55 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 15:01:55 user nova-compute[75703]:         </nova:port>
Nov 10 15:01:55 user nova-compute[75703]:       </nova:ports>
Nov 10 15:01:55 user nova-compute[75703]:     </nova:instance>
Nov 10 15:01:55 user nova-compute[75703]:   </metadata>
Nov 10 15:01:55 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:01:55 user nova-compute[75703]:     <system>
Nov 10 15:01:55 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:01:55 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:01:55 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:01:55 user nova-compute[75703]:       <entry name="serial">a660d0a5-43a3-4ded-8176-316bf54c556a</entry>
Nov 10 15:01:55 user nova-compute[75703]:       <entry name="uuid">a660d0a5-43a3-4ded-8176-316bf54c556a</entry>
Nov 10 15:01:55 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:01:55 user nova-compute[75703]:     </system>
Nov 10 15:01:55 user nova-compute[75703]:   </sysinfo>
Nov 10 15:01:55 user nova-compute[75703]:   <os>
Nov 10 15:01:55 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:01:55 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:01:55 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:01:55 user nova-compute[75703]:   </os>
Nov 10 15:01:55 user nova-compute[75703]:   <features>
Nov 10 15:01:55 user nova-compute[75703]:     <acpi/>
Nov 10 15:01:55 user nova-compute[75703]:     <apic/>
Nov 10 15:01:55 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:01:55 user nova-compute[75703]:   </features>
Nov 10 15:01:55 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:01:55 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:01:55 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:01:55 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:01:55 user nova-compute[75703]:   </clock>
Nov 10 15:01:55 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:01:55 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:01:55 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:01:55 user nova-compute[75703]:   </cpu>
Nov 10 15:01:55 user nova-compute[75703]:   <devices>
Nov 10 15:01:55 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 15:01:55 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:01:55 user nova-compute[75703]:       <source dev="/dev/sde"/>
Nov 10 15:01:55 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:01:55 user nova-compute[75703]:       <serial>a5a52271-1341-407f-996d-95c580acc6b4</serial>
Nov 10 15:01:55 user nova-compute[75703]:     </disk>
Nov 10 15:01:55 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:01:55 user nova-compute[75703]:       <mac address="fa:16:3e:67:61:80"/>
Nov 10 15:01:55 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:01:55 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:01:55 user nova-compute[75703]:       <target dev="tap76e9185b-15"/>
Nov 10 15:01:55 user nova-compute[75703]:     </interface>
Nov 10 15:01:55 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:01:55 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/a660d0a5-43a3-4ded-8176-316bf54c556a/console.log" append="off"/>
Nov 10 15:01:55 user nova-compute[75703]:     </serial>
Nov 10 15:01:55 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:01:55 user nova-compute[75703]:     <video>
Nov 10 15:01:55 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:01:55 user nova-compute[75703]:     </video>
Nov 10 15:01:55 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:01:55 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:01:55 user nova-compute[75703]:     </rng>
Nov 10 15:01:55 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:01:55 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:01:55 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:01:55 user nova-compute[75703]:     </memballoon>
Nov 10 15:01:55 user nova-compute[75703]:   </devices>
Nov 10 15:01:55 user nova-compute[75703]: </domain>
Nov 10 15:01:55 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2099456931',display_name='tempest-ServerActionsTestOtherA-server-2099456931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2099456931',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-fcv3dmop',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=a660d0a5-43a3-4ded-8176-316bf54c556a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1407612440-network", "vif_mac": "fa:16:3e:67:61:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG os_vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a40d065f-be54-5dd7-ac23-4e79b3028627', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:55 user nova-compute[75703]: INFO nova.compute.manager [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 15:01:55 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.policy [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67a5a4845f164d8cba0951d82f2430e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c013cf84f8b414ba6d2d888ddc2ee1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76e9185b-15, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76e9185b-15, col_values=(('qos', UUID('96719e2e-9c8e-44e2-92b7-2ad41eb416e9')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76e9185b-15, col_values=(('external_ids', {'iface-id': '76e9185b-15b2-42d6-a80f-b57c6d226695', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:61:80', 'vm-uuid': 'a660d0a5-43a3-4ded-8176-316bf54c556a'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:55 user nova-compute[75703]: INFO os_vif [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15')
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:01:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] No VIF found with MAC fa:16:3e:67:61:80, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.network.neutron [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Successfully created port: 6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:56 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Took 0.92 seconds to deallocate network for instance.
Nov 10 15:01:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] Acquiring lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] No waiting events found dispatching network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:56 user nova-compute[75703]: WARNING nova.compute.manager [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received unexpected event network-vif-plugged-2c05ad70-1d8d-43d9-a952-7d58ca951a8b for instance with vm_state deleted and task_state None.
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-42200be9-14ec-49f2-84d1-d944f6ff7718 req-c6b30aae-99d2-482d-a012-5083a179ce6e service nova] [instance: 36a3590e-c24d-459e-8a32-6f13a4e10498] Received event network-vif-deleted-2c05ad70-1d8d-43d9-a952-7d58ca951a8b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:01:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.678s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:57 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Deleted allocations for instance 36a3590e-c24d-459e-8a32-6f13a4e10498
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Successfully updated port: 6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquired lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-changed-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Refreshing instance network info cache due to event network-changed-6450e970-2465-4d9b-afbe-bd766e45e477. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] Acquiring lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-db2f556f-a2e3-4562-b008-ee4ef5db9d60 tempest-AttachVolumeTestJSON-1704980195 tempest-AttachVolumeTestJSON-1704980195-project-member] Lock "36a3590e-c24d-459e-8a32-6f13a4e10498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.846s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.network.neutron [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updating instance_info_cache with network_info: [{"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Releasing lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Instance network_info: |[{"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] Acquired lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:01:57 user nova-compute[75703]: DEBUG nova.network.neutron [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Refreshing network info cache for port 6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:01:58 user nova-compute[75703]: DEBUG nova.network.neutron [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updated VIF entry in instance network info cache for port 6450e970-2465-4d9b-afbe-bd766e45e477. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:01:58 user nova-compute[75703]: DEBUG nova.network.neutron [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updating instance_info_cache with network_info: [{"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:01:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-18657023-69a2-4f71-a26f-8abc3de75582 req-329de1b8-92cc-4462-8b83-23a560c6daaa service nova] Releasing lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:01:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance running successfully.
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Failed to set time: agent not configured {{(pid=75703) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2b0d8bda-ccdd-485b-b491-4bb27aa90dd8 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] finish_migration finished successfully. {{(pid=75703) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:59 user nova-compute[75703]: WARNING nova.compute.manager [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state active and task_state resize_finish.
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:01:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:01:59 user nova-compute[75703]: WARNING nova.compute.manager [req-bb9478df-b218-4081-98ec-f0e722fb641c req-189c95a0-67cf-40d1-abcb-649471ecdccf service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state active and task_state resize_finish.
Nov 10 15:01:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:00 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:00 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:02:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:02:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:01 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:02:01 user nova-compute[75703]: INFO nova.compute.claims [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Claim successful on node user
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:02:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:02:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Creating image(s)
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG nova.policy [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37caa38086ae47a0be1d7f6f6a5aa6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf2404e273a4409ae3a1bb5d57eed08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.242s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.237s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk 1073741824" returned: 0 in 0.060s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Successfully created port: e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Cannot resize image /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Ensure instance console log exists: /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Successfully updated port: e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquired lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-changed-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Refreshing instance network info cache due to event network-changed-e2570295-7c57-4c22-b9da-911adf6fe0b7. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] Acquiring lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Releasing lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance network_info: |[{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] Acquired lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.neutron [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Refreshing network info cache for port e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Start _get_guest_xml network_info=[{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:02:04 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:02:04 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126003728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126003728',id=39,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdw1u2qoOd7q3vELLmwdLPfjgxtXAqZJa0eq8AihVHD2jH7gX1z4EECZ2x5dfAvFGXe9PpcGEYsA6x4DRFQpnMXLwbfBdquDFaLTfOUqjpjVKFk5Th2gBDaRt1tOCCoAA==',key_name='tempest-keypair-1081069009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-q6163v6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=3c2c4c67-ae89-40fb-896e-adad9aab8847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:02:04 user nova-compute[75703]:   <uuid>3c2c4c67-ae89-40fb-896e-adad9aab8847</uuid>
Nov 10 15:02:04 user nova-compute[75703]:   <name>instance-00000027</name>
Nov 10 15:02:04 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:02:04 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:02:04 user nova-compute[75703]:   <metadata>
Nov 10 15:02:04 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:02:04 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:02:04 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-126003728</nova:name>
Nov 10 15:02:04 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:02:04</nova:creationTime>
Nov 10 15:02:04 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:02:04 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:02:04 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:02:04 user nova-compute[75703]:       <nova:owner>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:user uuid="37caa38086ae47a0be1d7f6f6a5aa6d6">tempest-AttachVolumeShelveTestJSON-2134379644-project-member</nova:user>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:project uuid="baf2404e273a4409ae3a1bb5d57eed08">tempest-AttachVolumeShelveTestJSON-2134379644</nova:project>
Nov 10 15:02:04 user nova-compute[75703]:       </nova:owner>
Nov 10 15:02:04 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:02:04 user nova-compute[75703]:       <nova:ports>
Nov 10 15:02:04 user nova-compute[75703]:         <nova:port uuid="e2570295-7c57-4c22-b9da-911adf6fe0b7">
Nov 10 15:02:04 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 15:02:04 user nova-compute[75703]:         </nova:port>
Nov 10 15:02:04 user nova-compute[75703]:       </nova:ports>
Nov 10 15:02:04 user nova-compute[75703]:     </nova:instance>
Nov 10 15:02:04 user nova-compute[75703]:   </metadata>
Nov 10 15:02:04 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:02:04 user nova-compute[75703]:     <system>
Nov 10 15:02:04 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:02:04 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:02:04 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:02:04 user nova-compute[75703]:       <entry name="serial">3c2c4c67-ae89-40fb-896e-adad9aab8847</entry>
Nov 10 15:02:04 user nova-compute[75703]:       <entry name="uuid">3c2c4c67-ae89-40fb-896e-adad9aab8847</entry>
Nov 10 15:02:04 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:02:04 user nova-compute[75703]:     </system>
Nov 10 15:02:04 user nova-compute[75703]:   </sysinfo>
Nov 10 15:02:04 user nova-compute[75703]:   <os>
Nov 10 15:02:04 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:02:04 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:02:04 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:02:04 user nova-compute[75703]:   </os>
Nov 10 15:02:04 user nova-compute[75703]:   <features>
Nov 10 15:02:04 user nova-compute[75703]:     <acpi/>
Nov 10 15:02:04 user nova-compute[75703]:     <apic/>
Nov 10 15:02:04 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:02:04 user nova-compute[75703]:   </features>
Nov 10 15:02:04 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:02:04 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:02:04 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:02:04 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:02:04 user nova-compute[75703]:   </clock>
Nov 10 15:02:04 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:02:04 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:02:04 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:02:04 user nova-compute[75703]:   </cpu>
Nov 10 15:02:04 user nova-compute[75703]:   <devices>
Nov 10 15:02:04 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:02:04 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:02:04 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk"/>
Nov 10 15:02:04 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:02:04 user nova-compute[75703]:     </disk>
Nov 10 15:02:04 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:02:04 user nova-compute[75703]:       <mac address="fa:16:3e:83:87:55"/>
Nov 10 15:02:04 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:02:04 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:02:04 user nova-compute[75703]:       <target dev="tape2570295-7c"/>
Nov 10 15:02:04 user nova-compute[75703]:     </interface>
Nov 10 15:02:04 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:02:04 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/console.log" append="off"/>
Nov 10 15:02:04 user nova-compute[75703]:     </serial>
Nov 10 15:02:04 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:02:04 user nova-compute[75703]:     <video>
Nov 10 15:02:04 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:02:04 user nova-compute[75703]:     </video>
Nov 10 15:02:04 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:02:04 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:02:04 user nova-compute[75703]:     </rng>
Nov 10 15:02:04 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:02:04 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:02:04 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:02:04 user nova-compute[75703]:     </memballoon>
Nov 10 15:02:04 user nova-compute[75703]:   </devices>
Nov 10 15:02:04 user nova-compute[75703]: </domain>
Nov 10 15:02:04 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126003728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126003728',id=39,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdw1u2qoOd7q3vELLmwdLPfjgxtXAqZJa0eq8AihVHD2jH7gX1z4EECZ2x5dfAvFGXe9PpcGEYsA6x4DRFQpnMXLwbfBdquDFaLTfOUqjpjVKFk5Th2gBDaRt1tOCCoAA==',key_name='tempest-keypair-1081069009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-q6163v6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=3c2c4c67-ae89-40fb-896e-adad9aab8847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG os_vif [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9deb79a-a199-5891-9cb9-79f54ae55649', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2570295-7c, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2570295-7c, col_values=(('qos', UUID('5f4684fe-9184-42ff-8433-602b35174dc3')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2570295-7c, col_values=(('external_ids', {'iface-id': 'e2570295-7c57-4c22-b9da-911adf6fe0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:87:55', 'vm-uuid': '3c2c4c67-ae89-40fb-896e-adad9aab8847'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:02:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:04 user nova-compute[75703]: INFO os_vif [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c')
Nov 10 15:02:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:02:05 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] No VIF found with MAC fa:16:3e:83:87:55, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:02:05 user nova-compute[75703]: DEBUG nova.network.neutron [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updated VIF entry in instance network info cache for port e2570295-7c57-4c22-b9da-911adf6fe0b7. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:02:05 user nova-compute[75703]: DEBUG nova.network.neutron [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-32a21040-f0e6-4eea-8f08-7df07577b2d4 req-12aa4d70-40cb-457c-94de-739e25599047 service nova] Releasing lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG os_brick.utils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed5e63b-4b83-4c9b-a997-6f0a7264acfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc51763e-9fd9-4f02-af47-255f3171802c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[733d4175-3cae-4b9a-9db1-22c69f3e12c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c7cd1-942b-43c7-8832-b3ed4d025585]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:02:06 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0e1850-a4ba-4c81-b737-b163017d6c41]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG os_brick.utils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updating existing volume attachment record: 2b7cdbbf-6b13-4332-8459-c5ea3e82c358 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-d6f36ec2-b50e-471d-9d60-5c15a35f4980 req-320ceb97-b6b2-472b-9815-d290794d00a7 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d6f36ec2-b50e-471d-9d60-5c15a35f4980 req-320ceb97-b6b2-472b-9815-d290794d00a7 service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d6f36ec2-b50e-471d-9d60-5c15a35f4980 req-320ceb97-b6b2-472b-9815-d290794d00a7 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d6f36ec2-b50e-471d-9d60-5c15a35f4980 req-320ceb97-b6b2-472b-9815-d290794d00a7 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-d6f36ec2-b50e-471d-9d60-5c15a35f4980 req-320ceb97-b6b2-472b-9815-d290794d00a7 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:06 user nova-compute[75703]: WARNING nova.compute.manager [req-d6f36ec2-b50e-471d-9d60-5c15a35f4980 req-320ceb97-b6b2-472b-9815-d290794d00a7 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state building and task_state spawning.
Nov 10 15:02:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:02:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-030f7788-d765-4784-98a6-cb8702a2ca03 req-5feceaa0-8b68-4237-b54b-de584cb73f59 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-030f7788-d765-4784-98a6-cb8702a2ca03 req-5feceaa0-8b68-4237-b54b-de584cb73f59 service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-030f7788-d765-4784-98a6-cb8702a2ca03 req-5feceaa0-8b68-4237-b54b-de584cb73f59 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-030f7788-d765-4784-98a6-cb8702a2ca03 req-5feceaa0-8b68-4237-b54b-de584cb73f59 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.compute.manager [req-030f7788-d765-4784-98a6-cb8702a2ca03 req-5feceaa0-8b68-4237-b54b-de584cb73f59 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:09 user nova-compute[75703]: WARNING nova.compute.manager [req-030f7788-d765-4784-98a6-cb8702a2ca03 req-5feceaa0-8b68-4237-b54b-de584cb73f59 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state building and task_state spawning.
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:02:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance spawned successfully.
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:10 user nova-compute[75703]: INFO nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Took 7.61 seconds to spawn the instance on the hypervisor.
Nov 10 15:02:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:10 user nova-compute[75703]: INFO nova.compute.manager [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Took 8.61 seconds to build instance.
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c48b64a-6770-43ac-8731-73be58de86f1 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.707s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:02:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:12 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:02:12 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:02:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7224MB free_disk=24.77218246459961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:02:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Applying migration context for instance a660d0a5-43a3-4ded-8176-316bf54c556a as it has an incoming, in-progress migration b3579598-1730-46d1-bba9-ba13ad950458. Migration status is finished {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 15:02:12 user nova-compute[75703]: INFO nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating resource usage from migration b3579598-1730-46d1-bba9-ba13ad950458
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e1842482-4120-40ff-843d-6395f6b14960 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fa433bf7-2318-4dce-b293-b3907a7ab390 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 69cd5c16-a011-43e5-a7e1-273fd1e332b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Migration b3579598-1730-46d1-bba9-ba13ad950458 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a660d0a5-43a3-4ded-8176-316bf54c556a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance eed6b98a-1245-4b30-bb64-cb16233f3af4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 3c2c4c67-ae89-40fb-896e-adad9aab8847 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:02:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.865s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:02:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [{"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:02:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emMaAcKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:02:22 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:02:22 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:02:22 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d7977-4430-4790-aa23-1e3bc70bebc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:02:22 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee974b-1112-49e1-832c-430562d11da8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575] added
Nov 10 15:02:22 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e99db7-cc9c-4fdd-aa01-4be8ec6d5bff]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6826f0-1b3f-473a-97de-5e409198af7e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emMaAcKV {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emMaAcKV" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6683a3e-186c-4654-b324-5a9df11be4dd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'emMaAcKV'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff892f-745b-419d-b8a7-c7c37fe6ec8a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f4915-2eca-4307-8cfc-28cbf40c3461]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce98e01-1270-488e-a2f0-eb9578d1dfdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260]
Nov 10 15:02:22 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260] successful.
Nov 10 15:02:22 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ef7cd0-18a5-4fe8-a0f2-ad1b45ec28ff]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7c05e-40a6-4ef3-af38-1a8e5c26bd07]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:22 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8960d2-c9fd-4864-8ee4-46f9f4c3afe1]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:22 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emMaAcKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23833303937393537', 'path': '/dev/sdf'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833303937393537', 'path': '/dev/sdf'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'flavor' on Instance uuid fa433bf7-2318-4dce-b293-b3907a7ab390 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:02:23 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:02:23 user nova-compute[75703]:   <source dev="/dev/sdf"/>
Nov 10 15:02:23 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:02:23 user nova-compute[75703]:   <serial>8f1fdb91-85a2-49f6-a498-920332f93575</serial>
Nov 10 15:02:23 user nova-compute[75703]: </disk>
Nov 10 15:02:23 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:02:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] No VIF found with MAC fa:16:3e:3d:c9:5a, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:02:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5240f760-b15a-4ae2-a7d3-07ab4b29c7c2 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.428s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing instance network info cache due to event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:02:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:02:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:02:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:02:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updated VIF entry in instance network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:02:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-47bfb75e-fa34-4009-adb6-1e4653c4781a req-fb82e624-2d51-491e-9c33-261a5079694d service nova] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "e1842482-4120-40ff-843d-6395f6b14960" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:29 user nova-compute[75703]: INFO nova.compute.manager [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Terminating instance
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing instance network info cache due to event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.network.neutron [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-43db02b2-bcda-4d52-ab03-bb7d04f02958 req-d7a9a55b-73d9-42f0-a4ca-c31594463866 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-43db02b2-bcda-4d52-ab03-bb7d04f02958 req-d7a9a55b-73d9-42f0-a4ca-c31594463866 service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-43db02b2-bcda-4d52-ab03-bb7d04f02958 req-d7a9a55b-73d9-42f0-a4ca-c31594463866 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-43db02b2-bcda-4d52-ab03-bb7d04f02958 req-d7a9a55b-73d9-42f0-a4ca-c31594463866 service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-43db02b2-bcda-4d52-ab03-bb7d04f02958 req-d7a9a55b-73d9-42f0-a4ca-c31594463866 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-43db02b2-bcda-4d52-ab03-bb7d04f02958 req-d7a9a55b-73d9-42f0-a4ca-c31594463866 service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-unplugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:29 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Instance destroyed successfully.
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'resources' on Instance uuid e1842482-4120-40ff-843d-6395f6b14960 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71868614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71868614',id=29,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-8qu751zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:00:43Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=e1842482-4120-40ff-843d-6395f6b14960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "address": "fa:16:3e:be:bc:45", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap539018f0-1a", "ovs_interfaceid": "539018f0-1a3d-4d66-8953-2dfe71dbff34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:02:29 user nova-compute[75703]: DEBUG os_vif [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap539018f0-1a, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=684bc276-3cb4-437e-a55f-28815626f0fd) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:02:30 user nova-compute[75703]: INFO os_vif [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:bc:45,bridge_name='br-int',has_traffic_filtering=True,id=539018f0-1a3d-4d66-8953-2dfe71dbff34,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539018f0-1a')
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZCcfmxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:02:30 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145a56c-1faf-4c20-b404-408bdf723939]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:02:30 user nova-compute[75703]: No targets found.
Nov 10 15:02:30 user nova-compute[75703]: iSNS:
Nov 10 15:02:30 user nova-compute[75703]: No targets found.
Nov 10 15:02:30 user nova-compute[75703]: STATIC:
Nov 10 15:02:30 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575
Nov 10 15:02:30 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:02:30 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:02:30 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:02:30 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:02:30 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:02:30 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:02:30 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:02:30 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:02:30 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9
Nov 10 15:02:30 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:02:30 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:02:30 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:02:30 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:02:30 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:02:30 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 15:02:30 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:02:30 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:02:30 user nova-compute[75703]: FIRMWARE:
Nov 10 15:02:30 user nova-compute[75703]: No targets found.
Nov 10 15:02:30 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:02:30 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:02:30 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[58959e55-8623-4bc6-904a-33db5be9041e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b708db2-c437-4922-a8f0-36955eb21404]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:30 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a466c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9'): ({'sdd'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Removing single pathed devices sdd {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:30 user nova-compute[75703]: INFO nova.compute.manager [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Rebooting instance
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ac098-39cf-40bd-8d53-e78b32724a39]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc166dc2-e479-4f6e-bd6f-f3a16469bdbb]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flushing IO for device /dev/sdd {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110da61-496c-41bd-b8b6-10f25830194d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.network.neutron [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updated VIF entry in instance network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.network.neutron [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-09de9a28-9327-4173-bb6e-d2c1017e64f0 req-bbd643d0-edb8-4aa3-8369-183d6706936f service nova] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.227s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[282588ce-a8eb-4f16-bdba-07539449e09a]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO92c49187-3b22d503b06093fe', '/dev/disk/by-id/scsi-23362323264353033', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_92c49187') {{(pid=87268) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e249f48-5bca-4cee-b5c8-ea759f93f720]: (4, None) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a64a8c-05eb-4e29-abc4-bddf199acfdf]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3deaa0-887a-44d1-ab9b-2200914548d0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260]
Nov 10 15:02:30 user nova-compute[75703]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9, portal: 172.16.0.220,3260] successful.
Nov 10 15:02:30 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62b52bf0-2fab-418c-b846-8e9ddf1e58b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d2d752-8a0a-40a0-af99-61b5f3ff12de]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.645s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== disconnect_volume: return (646ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:02:30 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Deleting instance files /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960_del
Nov 10 15:02:30 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Deletion of /opt/stack/data/nova/instances/e1842482-4120-40ff-843d-6395f6b14960_del complete
Nov 10 15:02:30 user nova-compute[75703]: INFO nova.compute.manager [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:02:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:02:31 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:02:31 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: e1842482-4120-40ff-843d-6395f6b14960] Took 0.53 seconds to deallocate network for instance.
Nov 10 15:02:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] Acquiring lock "e1842482-4120-40ff-843d-6395f6b14960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] Lock "e1842482-4120-40ff-843d-6395f6b14960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] No waiting events found dispatching network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:32 user nova-compute[75703]: WARNING nova.compute.manager [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received unexpected event network-vif-plugged-539018f0-1a3d-4d66-8953-2dfe71dbff34 for instance with vm_state active and task_state deleting.
Nov 10 15:02:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-1b7c7cf1-0de7-4b61-894b-3b89a7885858 req-679f6837-9f79-4fc9-83df-de2f1acba62e service nova] [instance: e1842482-4120-40ff-843d-6395f6b14960] Received event network-vif-deleted-539018f0-1a3d-4d66-8953-2dfe71dbff34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:32 user nova-compute[75703]: INFO nova.compute.manager [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: e1842482-4120-40ff-843d-6395f6b14960] Took 1.12 seconds to detach 1 volumes for instance.
Nov 10 15:02:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:02:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:02:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:33 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Deleted allocations for instance e1842482-4120-40ff-843d-6395f6b14960
Nov 10 15:02:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-17efee9d-ef60-4a3d-9100-14b6bd990d1b tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "e1842482-4120-40ff-843d-6395f6b14960" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.052s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:34 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance shutdown successfully.
Nov 10 15:02:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-unplugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-unplugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:34 user nova-compute[75703]: WARNING nova.compute.manager [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-unplugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state active and task_state reboot_started.
Nov 10 15:02:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:34 user nova-compute[75703]: DEBUG nova.compute.manager [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:34 user nova-compute[75703]: WARNING nova.compute.manager [req-c6a94ddc-a6b0-42df-84f6-a5b6c1734ba4 req-e6e74918-edc9-4251-aeb8-df2db8cfb322 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state active and task_state reboot_started.
Nov 10 15:02:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:02:36 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Creating image(s)
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Ensure instance console log exists: /opt/stack/data/nova/instances/eed6b98a-1245-4b30-bb64-cb16233f3af4/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Start _get_guest_xml network_info=[{"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T15:01:38Z,direct_url=<?>,disk_format='qcow2',id=48929113-c5d6-4456-81bb-882a303f03b4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-698661555',owner='3c013cf84f8b414ba6d2d888ddc2ee1b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T15:01:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '2b7cdbbf-6b13-4332-8459-c5ea3e82c358', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUdoEPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eed6b98a-1245-4b30-bb64-cb16233f3af4', 'attached_at': '', 'detached_at': '', 'volume_id': '335b9ac7-0a11-4c3d-af59-09b15266c3e5', 'serial': '335b9ac7-0a11-4c3d-af59-09b15266c3e5'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:02:36 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:02:36 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T15:01:38Z,direct_url=<?>,disk_format='qcow2',id=48929113-c5d6-4456-81bb-882a303f03b4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-698661555',owner='3c013cf84f8b414ba6d2d888ddc2ee1b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T15:01:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUdoEPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:02:36 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:02:36 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:02:36 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac47960-bf13-46dd-a6c4-a5129add9f9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:02:36 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[34927219-0b2c-4185-bb49-116698052f13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5] added
Nov 10 15:02:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8d348-2543-4e32-ad56-5331683cb98f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181d87b-e901-49db-945d-6464cd60e27b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVUdoEPr {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVUdoEPr" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a82549-2299-42e8-9680-8bc31d2ee09d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVUdoEPr'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0776a7a6-4c3b-4c6c-bc7f-877f85dbd34e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2758673a-d4ca-4225-9ca4-d2938691210d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:36 user nova-compute[75703]: WARNING nova.compute.manager [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state active and task_state reboot_started.
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:36 user nova-compute[75703]: WARNING nova.compute.manager [req-feec8be9-5c72-41d5-8f45-43d9f648f9dd req-6cf3e9fe-52ac-4997-9c91-5c2ba399cca2 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state active and task_state reboot_started.
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b14054-41bf-4a07-a838-3761e7e15a28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260]
Nov 10 15:02:36 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260] successful.
Nov 10 15:02:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b69a55a-26ee-4392-a796-3a03cc0f5973]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95a43dc-b12e-4388-acd0-dce5fcd129f9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 (non-flash)
Nov 10 15:02:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a8db79-bb89-4b41-bc69-c0d00e22650e]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:02:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUdoEPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26436653064633231', 'path': '/dev/sdd'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436653064633231', 'path': '/dev/sdd'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-442783219',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-442783219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-442783219',id=38,image_ref='48929113-c5d6-4456-81bb-882a303f03b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaiYKKZcUgnQnGD1l68LJspsP25pNi9331slYaJXx79WMcGpbzzc3yypiCztKN63n+5XKPGFegJ30IEUluASw1L/GHbu2PdG50brxEnYpIXsY2r0xqzdgz4oLkS7fzwkQ==',key_name='tempest-keypair-2054456991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-8r06kw7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-982390102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=eed6b98a-1245-4b30-bb64-cb16233f3af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'pci_devices' on Instance uuid eed6b98a-1245-4b30-bb64-cb16233f3af4 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:02:37 user nova-compute[75703]:   <uuid>eed6b98a-1245-4b30-bb64-cb16233f3af4</uuid>
Nov 10 15:02:37 user nova-compute[75703]:   <name>instance-00000026</name>
Nov 10 15:02:37 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:02:37 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:02:37 user nova-compute[75703]:   <metadata>
Nov 10 15:02:37 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:02:37 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:02:37 user nova-compute[75703]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-442783219</nova:name>
Nov 10 15:02:37 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:02:36</nova:creationTime>
Nov 10 15:02:37 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:02:37 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:02:37 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:02:37 user nova-compute[75703]:       <nova:owner>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:user uuid="67a5a4845f164d8cba0951d82f2430e9">tempest-TestVolumeBootPattern-982390102-project-member</nova:user>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:project uuid="3c013cf84f8b414ba6d2d888ddc2ee1b">tempest-TestVolumeBootPattern-982390102</nova:project>
Nov 10 15:02:37 user nova-compute[75703]:       </nova:owner>
Nov 10 15:02:37 user nova-compute[75703]:       <nova:root type="image" uuid="48929113-c5d6-4456-81bb-882a303f03b4"/>
Nov 10 15:02:37 user nova-compute[75703]:       <nova:ports>
Nov 10 15:02:37 user nova-compute[75703]:         <nova:port uuid="6450e970-2465-4d9b-afbe-bd766e45e477">
Nov 10 15:02:37 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 15:02:37 user nova-compute[75703]:         </nova:port>
Nov 10 15:02:37 user nova-compute[75703]:       </nova:ports>
Nov 10 15:02:37 user nova-compute[75703]:     </nova:instance>
Nov 10 15:02:37 user nova-compute[75703]:   </metadata>
Nov 10 15:02:37 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:02:37 user nova-compute[75703]:     <system>
Nov 10 15:02:37 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:02:37 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:02:37 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:02:37 user nova-compute[75703]:       <entry name="serial">eed6b98a-1245-4b30-bb64-cb16233f3af4</entry>
Nov 10 15:02:37 user nova-compute[75703]:       <entry name="uuid">eed6b98a-1245-4b30-bb64-cb16233f3af4</entry>
Nov 10 15:02:37 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:02:37 user nova-compute[75703]:     </system>
Nov 10 15:02:37 user nova-compute[75703]:   </sysinfo>
Nov 10 15:02:37 user nova-compute[75703]:   <os>
Nov 10 15:02:37 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:02:37 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:02:37 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:02:37 user nova-compute[75703]:   </os>
Nov 10 15:02:37 user nova-compute[75703]:   <features>
Nov 10 15:02:37 user nova-compute[75703]:     <acpi/>
Nov 10 15:02:37 user nova-compute[75703]:     <apic/>
Nov 10 15:02:37 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:02:37 user nova-compute[75703]:   </features>
Nov 10 15:02:37 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:02:37 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:02:37 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:02:37 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:02:37 user nova-compute[75703]:   </clock>
Nov 10 15:02:37 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:02:37 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:02:37 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:02:37 user nova-compute[75703]:   </cpu>
Nov 10 15:02:37 user nova-compute[75703]:   <devices>
Nov 10 15:02:37 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 15:02:37 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:02:37 user nova-compute[75703]:       <source dev="/dev/sdd"/>
Nov 10 15:02:37 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:02:37 user nova-compute[75703]:       <serial>335b9ac7-0a11-4c3d-af59-09b15266c3e5</serial>
Nov 10 15:02:37 user nova-compute[75703]:     </disk>
Nov 10 15:02:37 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:02:37 user nova-compute[75703]:       <mac address="fa:16:3e:5b:32:30"/>
Nov 10 15:02:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:02:37 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:02:37 user nova-compute[75703]:       <target dev="tap6450e970-24"/>
Nov 10 15:02:37 user nova-compute[75703]:     </interface>
Nov 10 15:02:37 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:02:37 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/eed6b98a-1245-4b30-bb64-cb16233f3af4/console.log" append="off"/>
Nov 10 15:02:37 user nova-compute[75703]:     </serial>
Nov 10 15:02:37 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:02:37 user nova-compute[75703]:     <video>
Nov 10 15:02:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:02:37 user nova-compute[75703]:     </video>
Nov 10 15:02:37 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:02:37 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:02:37 user nova-compute[75703]:     </rng>
Nov 10 15:02:37 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:02:37 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:02:37 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:02:37 user nova-compute[75703]:     </memballoon>
Nov 10 15:02:37 user nova-compute[75703]:   </devices>
Nov 10 15:02:37 user nova-compute[75703]: </domain>
Nov 10 15:02:37 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-442783219',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-442783219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-442783219',id=38,image_ref='48929113-c5d6-4456-81bb-882a303f03b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaiYKKZcUgnQnGD1l68LJspsP25pNi9331slYaJXx79WMcGpbzzc3yypiCztKN63n+5XKPGFegJ30IEUluASw1L/GHbu2PdG50brxEnYpIXsY2r0xqzdgz4oLkS7fzwkQ==',key_name='tempest-keypair-2054456991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-8r06kw7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-982390102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=eed6b98a-1245-4b30-bb64-cb16233f3af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG os_vif [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11d0ca0a-8131-5f1f-b6e0-c5c6ea8e1000', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6450e970-24, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6450e970-24, col_values=(('qos', UUID('7bc78c57-c2de-433f-aa39-9f29c5ca45a5')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6450e970-24, col_values=(('external_ids', {'iface-id': '6450e970-2465-4d9b-afbe-bd766e45e477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:32:30', 'vm-uuid': 'eed6b98a-1245-4b30-bb64-cb16233f3af4'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:37 user nova-compute[75703]: INFO os_vif [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24')
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No VIF found with MAC fa:16:3e:5b:32:30, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:02:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance running successfully.
Nov 10 15:02:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance soft rebooted successfully.
Nov 10 15:02:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:02:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb679b57-fb5d-4531-adea-4b9e1a07e9f5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.605s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-49408c31-4ba7-4a10-9572-468a981be590 req-987949bf-e813-4d14-88fb-3641ed9e8354 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-49408c31-4ba7-4a10-9572-468a981be590 req-987949bf-e813-4d14-88fb-3641ed9e8354 service nova] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-49408c31-4ba7-4a10-9572-468a981be590 req-987949bf-e813-4d14-88fb-3641ed9e8354 service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-49408c31-4ba7-4a10-9572-468a981be590 req-987949bf-e813-4d14-88fb-3641ed9e8354 service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-49408c31-4ba7-4a10-9572-468a981be590 req-987949bf-e813-4d14-88fb-3641ed9e8354 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] No waiting events found dispatching network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:39 user nova-compute[75703]: WARNING nova.compute.manager [req-49408c31-4ba7-4a10-9572-468a981be590 req-987949bf-e813-4d14-88fb-3641ed9e8354 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received unexpected event network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 for instance with vm_state building and task_state spawning.
Nov 10 15:02:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:02:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Instance spawned successfully.
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-927c09ad-6927-4ce4-b1db-a345391dc344 req-716b8a8c-6902-4017-98ca-18fd22ca916a service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-927c09ad-6927-4ce4-b1db-a345391dc344 req-716b8a8c-6902-4017-98ca-18fd22ca916a service nova] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-927c09ad-6927-4ce4-b1db-a345391dc344 req-716b8a8c-6902-4017-98ca-18fd22ca916a service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-927c09ad-6927-4ce4-b1db-a345391dc344 req-716b8a8c-6902-4017-98ca-18fd22ca916a service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-927c09ad-6927-4ce4-b1db-a345391dc344 req-716b8a8c-6902-4017-98ca-18fd22ca916a service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] No waiting events found dispatching network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:02:41 user nova-compute[75703]: WARNING nova.compute.manager [req-927c09ad-6927-4ce4-b1db-a345391dc344 req-716b8a8c-6902-4017-98ca-18fd22ca916a service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received unexpected event network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 for instance with vm_state building and task_state spawning.
Nov 10 15:02:41 user nova-compute[75703]: INFO nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 10 15:02:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:02:41 user nova-compute[75703]: INFO nova.compute.manager [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Took 47.21 seconds to build instance.
Nov 10 15:02:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22f0c45d-7b80-4d3c-b91e-d7d62549d168 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.377s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:02:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:02:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:02:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:02:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:02:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:02:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:01 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:03:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Going to confirm migration 2 {{(pid=75703) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquired lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.objects.instance [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'info_cache' on Instance uuid a660d0a5-43a3-4ded-8176-316bf54c556a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [{"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Releasing lock "refresh_cache-a660d0a5-43a3-4ded-8176-316bf54c556a" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.objects.instance [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'migration_context' on Instance uuid a660d0a5-43a3-4ded-8176-316bf54c556a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.objects.base [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Object Instance<a660d0a5-43a3-4ded-8176-316bf54c556a> lazy-loaded attributes: info_cache,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:03:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.695s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:07 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Deleted allocation for migration b3579598-1730-46d1-bba9-ba13ad950458
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-70c81579-1bae-42d0-9302-0a911299a643 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.847s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:03:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:03:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7063MB free_disk=24.739219665527344GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fa433bf7-2318-4dce-b293-b3907a7ab390 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 69cd5c16-a011-43e5-a7e1-273fd1e332b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a660d0a5-43a3-4ded-8176-316bf54c556a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance eed6b98a-1245-4b30-bb64-cb16233f3af4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 3c2c4c67-ae89-40fb-896e-adad9aab8847 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:03:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:03:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [{"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-642d3e1d-4973-4759-8396-0cf73dcfce41" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:03:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 3 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:03:14 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deletion of /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize failed
Nov 10 15:03:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:03:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:03:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:03:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:03:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:03:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:20 user nova-compute[75703]: INFO nova.compute.manager [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Terminating instance
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-52f5a3a7-3284-485c-8211-eb8a8a35eba4 req-a3265f49-de32-449b-8495-8073662e895e service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-vif-unplugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52f5a3a7-3284-485c-8211-eb8a8a35eba4 req-a3265f49-de32-449b-8495-8073662e895e service nova] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52f5a3a7-3284-485c-8211-eb8a8a35eba4 req-a3265f49-de32-449b-8495-8073662e895e service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-52f5a3a7-3284-485c-8211-eb8a8a35eba4 req-a3265f49-de32-449b-8495-8073662e895e service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-52f5a3a7-3284-485c-8211-eb8a8a35eba4 req-a3265f49-de32-449b-8495-8073662e895e service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] No waiting events found dispatching network-vif-unplugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-52f5a3a7-3284-485c-8211-eb8a8a35eba4 req-a3265f49-de32-449b-8495-8073662e895e service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-vif-unplugged-5c59212d-5578-46e9-8fc8-6370b473d081 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Instance destroyed successfully.
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'resources' on Instance uuid 40bbbbf2-cfbd-4658-96e1-bbf165da94dc {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2006680303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2006680303',id=24,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-mglshrcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:54:13Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=40bbbbf2-cfbd-4658-96e1-bbf165da94dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "5c59212d-5578-46e9-8fc8-6370b473d081", "address": "fa:16:3e:c8:60:f0", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59212d-55", "ovs_interfaceid": "5c59212d-5578-46e9-8fc8-6370b473d081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG os_vif [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c59212d-55, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8bbd87c-20ef-4e1d-ae06-f74d1ad81d8f) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:20 user nova-compute[75703]: INFO os_vif [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:60:f0,bridge_name='br-int',has_traffic_filtering=True,id=5c59212d-5578-46e9-8fc8-6370b473d081,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59212d-55')
Nov 10 15:03:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Deleting instance files /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc_del
Nov 10 15:03:20 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Deletion of /opt/stack/data/nova/instances/40bbbbf2-cfbd-4658-96e1-bbf165da94dc_del complete
Nov 10 15:03:21 user nova-compute[75703]: INFO nova.compute.manager [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 15:03:21 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:21 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Took 0.46 seconds to deallocate network for instance.
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-8485fc61-5a42-41fb-9ffb-efd8a4b4d030 req-dd2e22e4-532c-4cc9-a2ab-69dce7a0f0aa service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-vif-deleted-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:21 user nova-compute[75703]: INFO nova.compute.manager [req-8485fc61-5a42-41fb-9ffb-efd8a4b4d030 req-dd2e22e4-532c-4cc9-a2ab-69dce7a0f0aa service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Neutron deleted interface 5c59212d-5578-46e9-8fc8-6370b473d081; detaching it from the instance and deleting it from the info cache
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.network.neutron [req-8485fc61-5a42-41fb-9ffb-efd8a4b4d030 req-dd2e22e4-532c-4cc9-a2ab-69dce7a0f0aa service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.compute.manager [req-8485fc61-5a42-41fb-9ffb-efd8a4b4d030 req-dd2e22e4-532c-4cc9-a2ab-69dce7a0f0aa service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Detach interface failed, port_id=5c59212d-5578-46e9-8fc8-6370b473d081, reason: Instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:03:21 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:22 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Deleted allocations for instance 40bbbbf2-cfbd-4658-96e1-bbf165da94dc
Nov 10 15:03:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a5ddfb49-7224-4f64-92d6-249d91179ef3 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6d566e8-8d94-4c99-9e6b-1cbf1c532e98 req-729aca33-9e2d-4c78-badd-59e1212beb34 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received event network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6d566e8-8d94-4c99-9e6b-1cbf1c532e98 req-729aca33-9e2d-4c78-badd-59e1212beb34 service nova] Acquiring lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6d566e8-8d94-4c99-9e6b-1cbf1c532e98 req-729aca33-9e2d-4c78-badd-59e1212beb34 service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b6d566e8-8d94-4c99-9e6b-1cbf1c532e98 req-729aca33-9e2d-4c78-badd-59e1212beb34 service nova] Lock "40bbbbf2-cfbd-4658-96e1-bbf165da94dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-b6d566e8-8d94-4c99-9e6b-1cbf1c532e98 req-729aca33-9e2d-4c78-badd-59e1212beb34 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] No waiting events found dispatching network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:22 user nova-compute[75703]: WARNING nova.compute.manager [req-b6d566e8-8d94-4c99-9e6b-1cbf1c532e98 req-729aca33-9e2d-4c78-badd-59e1212beb34 service nova] [instance: 40bbbbf2-cfbd-4658-96e1-bbf165da94dc] Received unexpected event network-vif-plugged-5c59212d-5578-46e9-8fc8-6370b473d081 for instance with vm_state deleted and task_state None.
Nov 10 15:03:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:30 user nova-compute[75703]: INFO nova.compute.manager [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Unrescuing
Nov 10 15:03:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:03:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:03:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:03:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'flavor' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-2400833d-325c-44a7-8300-d869d320b4c4 req-106d5252-ff2e-4174-8330-7c49332db573 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2400833d-325c-44a7-8300-d869d320b4c4 req-106d5252-ff2e-4174-8330-7c49332db573 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2400833d-325c-44a7-8300-d869d320b4c4 req-106d5252-ff2e-4174-8330-7c49332db573 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2400833d-325c-44a7-8300-d869d320b4c4 req-106d5252-ff2e-4174-8330-7c49332db573 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-2400833d-325c-44a7-8300-d869d320b4c4 req-106d5252-ff2e-4174-8330-7c49332db573 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:31 user nova-compute[75703]: WARNING nova.compute.manager [req-2400833d-325c-44a7-8300-d869d320b4c4 req-106d5252-ff2e-4174-8330-7c49332db573 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:03:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance destroyed successfully.
Nov 10 15:03:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:33 user nova-compute[75703]: WARNING nova.compute.manager [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:03:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:33 user nova-compute[75703]: WARNING nova.compute.manager [req-a2934754-16a6-4213-990f-0045af5c0bbf req-040bda14-847c-4ce0-a454-78f457b61090 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state rescued and task_state unrescuing.
Nov 10 15:03:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-47551834-89db-48c0-85b2-0b6e008cfbb6 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:03:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-d947882d-85e4-45b3-8647-a418b454cea7 req-48169145-e3a6-4feb-ac99-23394a22275a service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d947882d-85e4-45b3-8647-a418b454cea7 req-48169145-e3a6-4feb-ac99-23394a22275a service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d947882d-85e4-45b3-8647-a418b454cea7 req-48169145-e3a6-4feb-ac99-23394a22275a service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d947882d-85e4-45b3-8647-a418b454cea7 req-48169145-e3a6-4feb-ac99-23394a22275a service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-d947882d-85e4-45b3-8647-a418b454cea7 req-48169145-e3a6-4feb-ac99-23394a22275a service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:35 user nova-compute[75703]: WARNING nova.compute.manager [req-d947882d-85e4-45b3-8647-a418b454cea7 req-48169145-e3a6-4feb-ac99-23394a22275a service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state active and task_state None.
Nov 10 15:03:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-changed-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Refreshing instance network info cache due to event network-changed-6450e970-2465-4d9b-afbe-bd766e45e477. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:03:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] Acquiring lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:03:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] Acquired lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:03:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Refreshing network info cache for port 6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG nova.network.neutron [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updated VIF entry in instance network info cache for port 6450e970-2465-4d9b-afbe-bd766e45e477. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG nova.network.neutron [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updating instance_info_cache with network_info: [{"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c4086d48-88f0-4b00-8a73-93b058ee2d0e req-5b8a4354-3999-4d1c-beaa-29808f7007a2 service nova] Releasing lock "refresh_cache-eed6b98a-1245-4b30-bb64-cb16233f3af4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:45 user nova-compute[75703]: INFO nova.compute.manager [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Terminating instance
Nov 10 15:03:45 user nova-compute[75703]: DEBUG nova.compute.manager [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:46 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Instance destroyed successfully.
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.objects.instance [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'resources' on Instance uuid eed6b98a-1245-4b30-bb64-cb16233f3af4 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-442783219',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-442783219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-442783219',id=38,image_ref='48929113-c5d6-4456-81bb-882a303f03b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaiYKKZcUgnQnGD1l68LJspsP25pNi9331slYaJXx79WMcGpbzzc3yypiCztKN63n+5XKPGFegJ30IEUluASw1L/GHbu2PdG50brxEnYpIXsY2r0xqzdgz4oLkS7fzwkQ==',key_name='tempest-keypair-2054456991',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-8r06kw7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-982390102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=eed6b98a-1245-4b30-bb64-cb16233f3af4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "6450e970-2465-4d9b-afbe-bd766e45e477", "address": "fa:16:3e:5b:32:30", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6450e970-24", "ovs_interfaceid": "6450e970-2465-4d9b-afbe-bd766e45e477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_vif [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6450e970-24, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bc78c57-c2de-433f-aa39-9f29c5ca45a5) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:03:46 user nova-compute[75703]: INFO os_vif [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:32:30,bridge_name='br-int',has_traffic_filtering=True,id=6450e970-2465-4d9b-afbe-bd766e45e477,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6450e970-24')
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVUdoEPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:03:46 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795234a-71de-413c-876f-63729c263263]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:03:46 user nova-compute[75703]: No targets found.
Nov 10 15:03:46 user nova-compute[75703]: iSNS:
Nov 10 15:03:46 user nova-compute[75703]: No targets found.
Nov 10 15:03:46 user nova-compute[75703]: STATIC:
Nov 10 15:03:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575
Nov 10 15:03:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:03:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:03:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:03:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:03:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:03:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5
Nov 10 15:03:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:03:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:03:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:03:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:03:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:03:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:03:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:03:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:03:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 15:03:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:03:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:03:46 user nova-compute[75703]: FIRMWARE:
Nov 10 15:03:46 user nova-compute[75703]: No targets found.
Nov 10 15:03:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:03:46 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:03:46 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[11925bba-476a-4bbe-bb2f-2e7472b1060a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c70499c-9ae2-48ed-a607-40c18e792e0c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 (non-flash)
Nov 10 15:03:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a41cf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5'): ({'sdd'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Removing single pathed devices sdd {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33959a1-cd38-4037-b262-53e106ace855]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d33c935-5e9c-4db8-ac32-2668ef966c81]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flushing IO for device /dev/sdd {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8ada2-b613-49db-be20-b3e476f3bdc7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94013fec-2a7c-44c7-9a47-37446c83e8ba]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b1c72-4ad9-4a0f-a1e7-f91b4a79aea3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b1a058-6460-4b64-b980-fc16c21239c6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260]
Nov 10 15:03:46 user nova-compute[75703]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5, portal: 172.16.0.220,3260] successful.
Nov 10 15:03:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335b9ac7-0a11-4c3d-af59-09b15266c3e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a43182-4007-454b-980d-adbb4e200010]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== disconnect_volume: return (389ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:03:46 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Deleting instance files /opt/stack/data/nova/instances/eed6b98a-1245-4b30-bb64-cb16233f3af4_del
Nov 10 15:03:46 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Deletion of /opt/stack/data/nova/instances/eed6b98a-1245-4b30-bb64-cb16233f3af4_del complete
Nov 10 15:03:46 user nova-compute[75703]: INFO nova.compute.manager [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-vif-unplugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] No waiting events found dispatching network-vif-unplugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-vif-unplugged-6450e970-2465-4d9b-afbe-bd766e45e477 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] Acquiring lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:46 user nova-compute[75703]: DEBUG nova.compute.manager [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] No waiting events found dispatching network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:03:46 user nova-compute[75703]: WARNING nova.compute.manager [req-890ba307-7b78-4108-998b-453bc5a02cbd req-cac90ab4-22da-4585-9a63-5e381bc43bed service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received unexpected event network-vif-plugged-6450e970-2465-4d9b-afbe-bd766e45e477 for instance with vm_state active and task_state deleting.
Nov 10 15:03:48 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:48 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Took 1.12 seconds to deallocate network for instance.
Nov 10 15:03:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-e85035c4-2786-4976-ab37-25f089342e10 req-4d6b8fc8-95cc-4f43-aac9-f7912818da02 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Received event network-vif-deleted-6450e970-2465-4d9b-afbe-bd766e45e477 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:48 user nova-compute[75703]: INFO nova.compute.manager [req-e85035c4-2786-4976-ab37-25f089342e10 req-4d6b8fc8-95cc-4f43-aac9-f7912818da02 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Neutron deleted interface 6450e970-2465-4d9b-afbe-bd766e45e477; detaching it from the instance and deleting it from the info cache
Nov 10 15:03:48 user nova-compute[75703]: DEBUG nova.network.neutron [req-e85035c4-2786-4976-ab37-25f089342e10 req-4d6b8fc8-95cc-4f43-aac9-f7912818da02 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-e85035c4-2786-4976-ab37-25f089342e10 req-4d6b8fc8-95cc-4f43-aac9-f7912818da02 service nova] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Detach interface failed, port_id=6450e970-2465-4d9b-afbe-bd766e45e477, reason: Instance eed6b98a-1245-4b30-bb64-cb16233f3af4 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:03:49 user nova-compute[75703]: INFO nova.compute.manager [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Took 1.12 seconds to detach 1 volumes for instance.
Nov 10 15:03:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: eed6b98a-1245-4b30-bb64-cb16233f3af4] Deleting volume: 335b9ac7-0a11-4c3d-af59-09b15266c3e5 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 15:03:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:03:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:03:49 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:03:49 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:03:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:49 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Deleted allocations for instance eed6b98a-1245-4b30-bb64-cb16233f3af4
Nov 10 15:03:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-50879bb1-4118-4d0f-b6a0-376f9e8c327e tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "eed6b98a-1245-4b30-bb64-cb16233f3af4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.344s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:03:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-changed-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Refreshing instance network info cache due to event network-changed-e2570295-7c57-4c22-b9da-911adf6fe0b7. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] Acquiring lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] Acquired lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG nova.network.neutron [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Refreshing network info cache for port e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG nova.network.neutron [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updated VIF entry in instance network info cache for port e2570295-7c57-4c22-b9da-911adf6fe0b7. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG nova.network.neutron [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:03:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-8cd0f2c3-7f4b-4057-b539-3057d2689eca req-c861ba2c-73d4-4542-9563-51ba9946f31b service nova] Releasing lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:03:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:03:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:04:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:05 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:05 user nova-compute[75703]: INFO nova.compute.manager [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Shelving
Nov 10 15:04:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-6ea0f332-5ca4-4149-ac7d-61bfb7ebd016 req-9b0ea4ca-5066-4b6e-843a-12acfec5febf service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-unplugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6ea0f332-5ca4-4149-ac7d-61bfb7ebd016 req-9b0ea4ca-5066-4b6e-843a-12acfec5febf service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6ea0f332-5ca4-4149-ac7d-61bfb7ebd016 req-9b0ea4ca-5066-4b6e-843a-12acfec5febf service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6ea0f332-5ca4-4149-ac7d-61bfb7ebd016 req-9b0ea4ca-5066-4b6e-843a-12acfec5febf service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG nova.compute.manager [req-6ea0f332-5ca4-4149-ac7d-61bfb7ebd016 req-9b0ea4ca-5066-4b6e-843a-12acfec5febf service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-unplugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:06 user nova-compute[75703]: WARNING nova.compute.manager [req-6ea0f332-5ca4-4149-ac7d-61bfb7ebd016 req-9b0ea4ca-5066-4b6e-843a-12acfec5febf service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-unplugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state active and task_state shelving.
Nov 10 15:04:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance destroyed successfully.
Nov 10 15:04:06 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Beginning cold snapshot process
Nov 10 15:04:06 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 15:04:06 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk /opt/stack/data/nova/instances/snapshots/tmpcyyuzd_n/842f48a5df6740cdaa8d220b16db6330 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:07 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk /opt/stack/data/nova/instances/snapshots/tmpcyyuzd_n/842f48a5df6740cdaa8d220b16db6330" returned: 0 in 0.828s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:07 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Snapshot extracted, beginning image upload
Nov 10 15:04:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-540079fe-4354-4bd0-b236-fdfbb9e5fd57 req-c02f6ebc-57fc-4872-9d88-b23668c13b1b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-540079fe-4354-4bd0-b236-fdfbb9e5fd57 req-c02f6ebc-57fc-4872-9d88-b23668c13b1b service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-540079fe-4354-4bd0-b236-fdfbb9e5fd57 req-c02f6ebc-57fc-4872-9d88-b23668c13b1b service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-540079fe-4354-4bd0-b236-fdfbb9e5fd57 req-c02f6ebc-57fc-4872-9d88-b23668c13b1b service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-540079fe-4354-4bd0-b236-fdfbb9e5fd57 req-c02f6ebc-57fc-4872-9d88-b23668c13b1b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:08 user nova-compute[75703]: WARNING nova.compute.manager [req-540079fe-4354-4bd0-b236-fdfbb9e5fd57 req-c02f6ebc-57fc-4872-9d88-b23668c13b1b service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:04:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Snapshot image upload complete
Nov 10 15:04:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:10 user nova-compute[75703]: INFO nova.compute.manager [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Shelve offloading
Nov 10 15:04:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance destroyed successfully.
Nov 10 15:04:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquired lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:10 user nova-compute[75703]: INFO nova.compute.manager [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Terminating instance
Nov 10 15:04:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-5aa18c69-d586-4dcd-afd7-28a8970444e0 req-6640b970-35d9-4729-869a-ccaf65332e23 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5aa18c69-d586-4dcd-afd7-28a8970444e0 req-6640b970-35d9-4729-869a-ccaf65332e23 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5aa18c69-d586-4dcd-afd7-28a8970444e0 req-6640b970-35d9-4729-869a-ccaf65332e23 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5aa18c69-d586-4dcd-afd7-28a8970444e0 req-6640b970-35d9-4729-869a-ccaf65332e23 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-5aa18c69-d586-4dcd-afd7-28a8970444e0 req-6640b970-35d9-4729-869a-ccaf65332e23 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-5aa18c69-d586-4dcd-afd7-28a8970444e0 req-6640b970-35d9-4729-869a-ccaf65332e23 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-unplugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Releasing lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Instance destroyed successfully.
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'resources' on Instance uuid 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:44:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1625523003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1625523003',id=12,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-u0in6oq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:50:26Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "address": "fa:16:3e:f9:3f:94", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a7cd975-41", "ovs_interfaceid": "4a7cd975-41b4-4c54-a814-a852835e2e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_vif [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a7cd975-41, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69c14c4f-22f1-4c0b-bfd9-f2c453ae4655) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:11 user nova-compute[75703]: INFO os_vif [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3f:94,bridge_name='br-int',has_traffic_filtering=True,id=4a7cd975-41b4-4c54-a814-a852835e2e5f,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a7cd975-41')
Nov 10 15:04:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEtYmZRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:04:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4145ec78-9a9b-4b90-b4cc-4ef0a65e46af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:04:11 user nova-compute[75703]: No targets found.
Nov 10 15:04:11 user nova-compute[75703]: iSNS:
Nov 10 15:04:11 user nova-compute[75703]: No targets found.
Nov 10 15:04:11 user nova-compute[75703]: STATIC:
Nov 10 15:04:11 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575
Nov 10 15:04:11 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:11 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:11 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:04:11 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:11 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:11 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:04:11 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:11 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:11 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:04:11 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:11 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:11 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d
Nov 10 15:04:11 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:11 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:11 user nova-compute[75703]: FIRMWARE:
Nov 10 15:04:11 user nova-compute[75703]: No targets found.
Nov 10 15:04:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:04:11 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:04:11 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a46f1e7-ada2-476b-ba24-98accf2c9b29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e6968-209f-4303-a218-79b387bee4aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:04:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a41cf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d'): ({'sdk'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Removing single pathed devices sdk {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[12613d50-893d-40d5-90ff-1ce14b54d1f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[929c0b76-057d-46e8-ac0a-05975e32c8e6]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Flushing IO for device /dev/sdk {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e87f0f4-01e0-4e7e-827a-af63f3383e28]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:04:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.046s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bffb59d-44d3-4f4a-8ede-d64a0169028c]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] SCSI volumes sdk have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9fe162-63c2-4458-ab60-7f3a22735796]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance destroyed successfully.
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'resources' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83eda41-befc-4cb1-a533-f57e02f4a947]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260]
Nov 10 15:04:12 user nova-compute[75703]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d, portal: 172.16.0.220,3260] successful.
Nov 10 15:04:12 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126003728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126003728',id=39,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdw1u2qoOd7q3vELLmwdLPfjgxtXAqZJa0eq8AihVHD2jH7gX1z4EECZ2x5dfAvFGXe9PpcGEYsA6x4DRFQpnMXLwbfBdquDFaLTfOUqjpjVKFk5Th2gBDaRt1tOCCoAA==',key_name='tempest-keypair-1081069009',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-q6163v6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member',shelved_at='2023-11-10T15:04:10.532746',shelved_host='user',shelved_image_id='83a93182-1a61-44db-a08c-be4bc99723c1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=3c2c4c67-ae89-40fb-896e-adad9aab8847,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_vif [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2570295-7c, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f4684fe-9184-42ff-8433-602b35174dc3) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b9ce8e-52b5-4ae4-a0ad-3b0ef0c8db4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6f8c53-09f1-4bf9-a8e0-fa875a0f39d7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] <== disconnect_volume: return (430ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Deleting instance files /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15_del
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Deletion of /opt/stack/data/nova/instances/9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15_del complete
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:12 user nova-compute[75703]: INFO os_vif [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c')
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Deleting instance files /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847_del
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Deletion of /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847_del complete
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.compute.manager [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:04:12 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Deleted allocations for instance 3c2c4c67-ae89-40fb-896e-adad9aab8847
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.objects.base [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Object Instance<3c2c4c67-ae89-40fb-896e-adad9aab8847> lazy-loaded attributes: resources,numa_topology {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:04:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:04:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7564MB free_disk=24.80340576171875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:13 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Took 0.85 seconds to deallocate network for instance.
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.798s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.165s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] Acquiring lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] No waiting events found dispatching network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:13 user nova-compute[75703]: WARNING nova.compute.manager [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received unexpected event network-vif-plugged-4a7cd975-41b4-4c54-a814-a852835e2e5f for instance with vm_state active and task_state deleting.
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-c2e03731-6904-4017-b387-5367503aad05 req-dcd3b713-8fd4-43df-bf99-b58634d6fdc1 service nova] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Received event network-vif-deleted-4a7cd975-41b4-4c54-a814-a852835e2e5f {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5a678dc6-bb70-4b1c-b870-ac5af7b49f7e tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.583s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fa433bf7-2318-4dce-b293-b3907a7ab390 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 69cd5c16-a011-43e5-a7e1-273fd1e332b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a660d0a5-43a3-4ded-8176-316bf54c556a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:04:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:14 user nova-compute[75703]: INFO nova.compute.manager [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15] Took 1.09 seconds to detach 1 volumes for instance.
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:14 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Deleted allocations for instance 9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-5b19317d-b8da-47c6-90e7-a5b7d50e6542 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "9ee5c80d-1bcd-4dd7-97ad-9d8cc08ecd15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.996s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:04:14 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing instance network info cache due to event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updated VIF entry in instance network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-1274b77e-8485-4b0b-9984-032b76080f3f req-b4c2f278-6473-46d0-9a13-f4a2ab4412e8 service nova] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing instance network info cache due to event network-changed-a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] Acquiring lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] Acquired lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Refreshing network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:23 user nova-compute[75703]: INFO nova.compute.manager [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Detaching volume 8f1fdb91-85a2-49f6-a498-920332f93575
Nov 10 15:04:23 user nova-compute[75703]: INFO nova.virt.block_device [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Attempting to driver detach volume 8f1fdb91-85a2-49f6-a498-920332f93575 from mountpoint /dev/vdb
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Attempting to detach device vdb from instance fa433bf7-2318-4dce-b293-b3907a7ab390 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:04:23 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:04:23 user nova-compute[75703]:   <source dev="/dev/sdf"/>
Nov 10 15:04:23 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:04:23 user nova-compute[75703]:   <serial>8f1fdb91-85a2-49f6-a498-920332f93575</serial>
Nov 10 15:04:23 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:04:23 user nova-compute[75703]: </disk>
Nov 10 15:04:23 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:04:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully detached device vdb from instance fa433bf7-2318-4dce-b293-b3907a7ab390 from the persistent domain config.
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa433bf7-2318-4dce-b293-b3907a7ab390 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:04:23 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:04:23 user nova-compute[75703]:   <source dev="/dev/sdf"/>
Nov 10 15:04:23 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:04:23 user nova-compute[75703]:   <serial>8f1fdb91-85a2-49f6-a498-920332f93575</serial>
Nov 10 15:04:23 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:04:23 user nova-compute[75703]: </disk>
Nov 10 15:04:23 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updated VIF entry in instance network info cache for port a5306b79-542a-42d1-b6bf-182c7265275b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [{"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bb891f1a-8af5-4819-bd25-14272ed03806 req-6e9f96a3-352a-41d7-a384-4f761f89b619 service nova] Releasing lock "refresh_cache-fa433bf7-2318-4dce-b293-b3907a7ab390" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:04:24 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa433bf7-2318-4dce-b293-b3907a7ab390 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:04:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:25 user nova-compute[75703]: INFO nova.compute.manager [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Terminating instance
Nov 10 15:04:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-f5502b78-0296-4edc-87a1-7a48c1ee010f req-89b290bd-13a1-4a85-954f-20daed7ccfb3 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-vif-unplugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f5502b78-0296-4edc-87a1-7a48c1ee010f req-89b290bd-13a1-4a85-954f-20daed7ccfb3 service nova] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f5502b78-0296-4edc-87a1-7a48c1ee010f req-89b290bd-13a1-4a85-954f-20daed7ccfb3 service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f5502b78-0296-4edc-87a1-7a48c1ee010f req-89b290bd-13a1-4a85-954f-20daed7ccfb3 service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-f5502b78-0296-4edc-87a1-7a48c1ee010f req-89b290bd-13a1-4a85-954f-20daed7ccfb3 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] No waiting events found dispatching network-vif-unplugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-f5502b78-0296-4edc-87a1-7a48c1ee010f req-89b290bd-13a1-4a85-954f-20daed7ccfb3 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-vif-unplugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:04:26 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Instance destroyed successfully.
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lazy-loading 'resources' on Instance uuid 1a4d9342-78d9-47df-b1c8-1fa64fcb13da {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1842189213',display_name='tempest-ServersNegativeTestJSON-server-1842189213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1842189213',id=27,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='482ca92ae18d432da1805be8bcdb88dd',ramdisk_id='',reservation_id='r-n0kwl7ut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2142185333',owner_user_name='tempest-ServersNegativeTestJSON-2142185333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:55:19Z,user_data=None,user_id='9806be7af5fd410d971f2384899eab85',uuid=1a4d9342-78d9-47df-b1c8-1fa64fcb13da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converting VIF {"id": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "address": "fa:16:3e:b3:67:dd", "network": {"id": "2a5005ac-eea0-4619-8bd7-f4d42d7ddd38", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1618761115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482ca92ae18d432da1805be8bcdb88dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedef7f0-a5", "ovs_interfaceid": "eedef7f0-a5fc-48f9-9481-cd8b7e15ee34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG os_vif [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeedef7f0-a5, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed7825c0-fc2f-4b75-94d8-63e329fae65d) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:26 user nova-compute[75703]: INFO os_vif [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:67:dd,bridge_name='br-int',has_traffic_filtering=True,id=eedef7f0-a5fc-48f9-9481-cd8b7e15ee34,network=Network(2a5005ac-eea0-4619-8bd7-f4d42d7ddd38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedef7f0-a5')
Nov 10 15:04:26 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Deleting instance files /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da_del
Nov 10 15:04:26 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Deletion of /opt/stack/data/nova/instances/1a4d9342-78d9-47df-b1c8-1fa64fcb13da_del complete
Nov 10 15:04:26 user nova-compute[75703]: INFO nova.compute.manager [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 15:04:26 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:26 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Took 0.47 seconds to deallocate network for instance.
Nov 10 15:04:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-4d0cd6ee-e0c3-4f4c-b619-9db2b5999157 req-9bb876bc-3cfe-4caa-8903-c7551a8a7932 service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-vif-deleted-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:27 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Deleted allocations for instance 1a4d9342-78d9-47df-b1c8-1fa64fcb13da
Nov 10 15:04:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a83d4e06-2379-4026-91a0-8d1538726584 tempest-ServersNegativeTestJSON-2142185333 tempest-ServersNegativeTestJSON-2142185333-project-member] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-aef19e7b-b00c-4aaa-b3eb-2ecf4bb26ecc req-84e71e31-d62e-4e39-8e91-7c0e1e7ab0ab service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received event network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aef19e7b-b00c-4aaa-b3eb-2ecf4bb26ecc req-84e71e31-d62e-4e39-8e91-7c0e1e7ab0ab service nova] Acquiring lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aef19e7b-b00c-4aaa-b3eb-2ecf4bb26ecc req-84e71e31-d62e-4e39-8e91-7c0e1e7ab0ab service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aef19e7b-b00c-4aaa-b3eb-2ecf4bb26ecc req-84e71e31-d62e-4e39-8e91-7c0e1e7ab0ab service nova] Lock "1a4d9342-78d9-47df-b1c8-1fa64fcb13da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-aef19e7b-b00c-4aaa-b3eb-2ecf4bb26ecc req-84e71e31-d62e-4e39-8e91-7c0e1e7ab0ab service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] No waiting events found dispatching network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:27 user nova-compute[75703]: WARNING nova.compute.manager [req-aef19e7b-b00c-4aaa-b3eb-2ecf4bb26ecc req-84e71e31-d62e-4e39-8e91-7c0e1e7ab0ab service nova] [instance: 1a4d9342-78d9-47df-b1c8-1fa64fcb13da] Received unexpected event network-vif-plugged-eedef7f0-a5fc-48f9-9481-cd8b7e15ee34 for instance with vm_state deleted and task_state None.
Nov 10 15:04:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:44 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa433bf7-2318-4dce-b293-b3907a7ab390 is timed out.
Nov 10 15:04:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully detached device vdb from instance fa433bf7-2318-4dce-b293-b3907a7ab390 from the live domain config.
Nov 10 15:04:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emMaAcKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:04:44 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bbdf64-f7aa-4b12-9d4b-26758e912037]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:04:44 user nova-compute[75703]: No targets found.
Nov 10 15:04:44 user nova-compute[75703]: iSNS:
Nov 10 15:04:44 user nova-compute[75703]: No targets found.
Nov 10 15:04:44 user nova-compute[75703]: STATIC:
Nov 10 15:04:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575
Nov 10 15:04:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:04:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:04:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:44 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:04:44 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:44 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:44 user nova-compute[75703]: FIRMWARE:
Nov 10 15:04:44 user nova-compute[75703]: No targets found.
Nov 10 15:04:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:04:44 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:04:44 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1cb5d-f61d-43ad-bb3f-98e77ca082a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2a2747-7387-4566-87a4-8cb8d2473353]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 (non-flash)
Nov 10 15:04:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a420dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575'): ({'sdf'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Removing single pathed devices sdf {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa42d2-e0af-4c3b-959f-b0f358f79160]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab4a3b-8f8f-4334-80c7-30b9bc0b56a8]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Flushing IO for device /dev/sdf {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[44767c2b-5a46-4b63-aced-a33affc2dcce]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea0408e-7c44-4fc6-b764-bc6c9b2fe462]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] SCSI volumes sdf have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f21644-34f1-45b5-81f6-4a544f8cee44]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce7d561-2da7-442e-a9f8-9393c25675c8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260]
Nov 10 15:04:44 user nova-compute[75703]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575, portal: 172.16.0.220,3260] successful.
Nov 10 15:04:44 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f1fdb91-85a2-49f6-a498-920332f93575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4be3656-4631-4bc4-865d-3d35543f6180]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] <== disconnect_volume: return (296ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:04:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:04:45 user nova-compute[75703]: DEBUG nova.objects.instance [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'flavor' on Instance uuid fa433bf7-2318-4dce-b293-b3907a7ab390 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:04:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da4b0963-915e-4535-b433-92a542400465 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:48 user nova-compute[75703]: INFO nova.compute.manager [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Terminating instance
Nov 10 15:04:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-31c26cd7-4402-4a21-bbe0-abb4f3063b30 req-36928102-567c-4191-8a66-219f4a66e6ab service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-vif-unplugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-31c26cd7-4402-4a21-bbe0-abb4f3063b30 req-36928102-567c-4191-8a66-219f4a66e6ab service nova] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-31c26cd7-4402-4a21-bbe0-abb4f3063b30 req-36928102-567c-4191-8a66-219f4a66e6ab service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-31c26cd7-4402-4a21-bbe0-abb4f3063b30 req-36928102-567c-4191-8a66-219f4a66e6ab service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-31c26cd7-4402-4a21-bbe0-abb4f3063b30 req-36928102-567c-4191-8a66-219f4a66e6ab service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] No waiting events found dispatching network-vif-unplugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-31c26cd7-4402-4a21-bbe0-abb4f3063b30 req-36928102-567c-4191-8a66-219f4a66e6ab service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-vif-unplugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:04:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Instance destroyed successfully.
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'resources' on Instance uuid 69cd5c16-a011-43e5-a7e1-273fd1e332b3 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1326957089',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1326957089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1326957089',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsk3+aB4ff3xgjtO/jGm/gFET5Imi1Dl3h0TG0acAR7PMJKHMBT2cAGTm57Jq3DR3k+X7PRs68Z82OX/4WR43NjRqCUXQ/RZNWKJCxHqTSG8pD/L8SJ0qItX0zyYCE3+Q==',key_name='tempest-keypair-1844582802',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-90tw4xjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=69cd5c16-a011-43e5-a7e1-273fd1e332b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "address": "fa:16:3e:d3:a6:c1", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a8f0f29-23", "ovs_interfaceid": "1a8f0f29-2317-44c0-b2c9-96b35b3aaeab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_vif [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a8f0f29-23, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06962b0f-927d-4b36-b809-39477036c15d) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:49 user nova-compute[75703]: INFO os_vif [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:a6:c1,bridge_name='br-int',has_traffic_filtering=True,id=1a8f0f29-2317-44c0-b2c9-96b35b3aaeab,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a8f0f29-23')
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLozVqka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:04:49 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf9c8e-571e-4601-a56f-03b3f2e7122b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:04:49 user nova-compute[75703]: No targets found.
Nov 10 15:04:49 user nova-compute[75703]: iSNS:
Nov 10 15:04:49 user nova-compute[75703]: No targets found.
Nov 10 15:04:49 user nova-compute[75703]: STATIC:
Nov 10 15:04:49 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:04:49 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:49 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:49 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:04:49 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:49 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:49 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575
Nov 10 15:04:49 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:04:49 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:04:49 user nova-compute[75703]: FIRMWARE:
Nov 10 15:04:49 user nova-compute[75703]: No targets found.
Nov 10 15:04:49 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:04:49 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:04:49 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fd9844-66c8-40f8-afa1-e215c3707cec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b252a9-cf90-4c64-ae08-2301cd28050a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:04:49 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:04:49 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:04:49 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 (non-flash)
Nov 10 15:04:49 user nova-compute[75703]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:04:49 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:04:49 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43e8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bff5eb4-4d3e-4be7-887b-b4333f4becdc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9b7d6-2a2f-41b0-b859-2ecf245a602f]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[05145628-bb22-4d19-8282-19b097ca9df9]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376828b-21f3-4136-8a59-6908e02f7970]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99bd2af-2362-4736-9e6e-cd4e20436735]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cfed7b-ffb9-42f8-95bf-f50680e8088e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260]
Nov 10 15:04:49 user nova-compute[75703]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575, portal: 172.16.0.220,3260] successful.
Nov 10 15:04:49 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccea566-e663-4d55-97b8-1b5796f6d575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cd0329-fda5-4ccc-8239-9d24adac7911]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== disconnect_volume: return (331ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:04:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Deleting instance files /opt/stack/data/nova/instances/69cd5c16-a011-43e5-a7e1-273fd1e332b3_del
Nov 10 15:04:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Deletion of /opt/stack/data/nova/instances/69cd5c16-a011-43e5-a7e1-273fd1e332b3_del complete
Nov 10 15:04:49 user nova-compute[75703]: INFO nova.compute.manager [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 10 15:04:49 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:04:49 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:04:50 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:04:50 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Took 0.76 seconds to deallocate network for instance.
Nov 10 15:04:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-a0dd3c30-9350-41c8-8ef4-adc6d54003b8 req-644614b2-5877-42b2-b0cb-0e7246c2f74b service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-vif-deleted-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-c41227be-5c05-4011-8d12-7927afadb30c req-8819956b-4f38-469a-8b02-6dbb82220ef9 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received event network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c41227be-5c05-4011-8d12-7927afadb30c req-8819956b-4f38-469a-8b02-6dbb82220ef9 service nova] Acquiring lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c41227be-5c05-4011-8d12-7927afadb30c req-8819956b-4f38-469a-8b02-6dbb82220ef9 service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c41227be-5c05-4011-8d12-7927afadb30c req-8819956b-4f38-469a-8b02-6dbb82220ef9 service nova] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-c41227be-5c05-4011-8d12-7927afadb30c req-8819956b-4f38-469a-8b02-6dbb82220ef9 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] No waiting events found dispatching network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:04:51 user nova-compute[75703]: WARNING nova.compute.manager [req-c41227be-5c05-4011-8d12-7927afadb30c req-8819956b-4f38-469a-8b02-6dbb82220ef9 service nova] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Received unexpected event network-vif-plugged-1a8f0f29-2317-44c0-b2c9-96b35b3aaeab for instance with vm_state active and task_state deleting.
Nov 10 15:04:51 user nova-compute[75703]: INFO nova.compute.manager [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Took 1.15 seconds to detach 1 volumes for instance.
Nov 10 15:04:51 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 69cd5c16-a011-43e5-a7e1-273fd1e332b3] Deleting volume: dccea566-e663-4d55-97b8-1b5796f6d575 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:04:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:04:52 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:04:52 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:04:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:52 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Deleted allocations for instance 69cd5c16-a011-43e5-a7e1-273fd1e332b3
Nov 10 15:04:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbb82f2-5e53-435e-8a21-83c3990d050c tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "69cd5c16-a011-43e5-a7e1-273fd1e332b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.701s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:04:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:04:56 user nova-compute[75703]: INFO nova.compute.manager [None req-3d984af7-1450-4623-a020-9e5ae43aa547 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Get console output
Nov 10 15:04:57 user nova-compute[75703]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 15:04:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:04:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:01 user nova-compute[75703]: INFO nova.compute.manager [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Terminating instance
Nov 10 15:05:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-105ca7de-43de-4236-ab1b-689cc64c71af req-36de8a96-4e59-4991-950c-93192860d723 service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-vif-unplugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-105ca7de-43de-4236-ab1b-689cc64c71af req-36de8a96-4e59-4991-950c-93192860d723 service nova] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-105ca7de-43de-4236-ab1b-689cc64c71af req-36de8a96-4e59-4991-950c-93192860d723 service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-105ca7de-43de-4236-ab1b-689cc64c71af req-36de8a96-4e59-4991-950c-93192860d723 service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-105ca7de-43de-4236-ab1b-689cc64c71af req-36de8a96-4e59-4991-950c-93192860d723 service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] No waiting events found dispatching network-vif-unplugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-105ca7de-43de-4236-ab1b-689cc64c71af req-36de8a96-4e59-4991-950c-93192860d723 service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-vif-unplugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Instance destroyed successfully.
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lazy-loading 'resources' on Instance uuid 40c0bb3c-e83a-4d70-9299-a94c686cda28 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2114339608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2114339608',id=3,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:42:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19b6b93f7b4e6dbe0ded4d084792f2',ramdisk_id='',reservation_id='r-hffz13db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:43:56Z,user_data=None,user_id='90957e8164224a1285c067f0313178a2',uuid=40c0bb3c-e83a-4d70-9299-a94c686cda28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converting VIF {"id": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "address": "fa:16:3e:3d:03:ec", "network": {"id": "20d1bf94-4625-4608-8cc2-0339002e0ef0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-444432901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19b6b93f7b4e6dbe0ded4d084792f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53c7bac2-78", "ovs_interfaceid": "53c7bac2-78b6-4148-836e-fd8c994d3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG os_vif [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53c7bac2-78, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=befbf300-5a01-4fa9-a095-8e6e23d4de1d) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:02 user nova-compute[75703]: INFO os_vif [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:03:ec,bridge_name='br-int',has_traffic_filtering=True,id=53c7bac2-78b6-4148-836e-fd8c994d3d45,network=Network(20d1bf94-4625-4608-8cc2-0339002e0ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53c7bac2-78')
Nov 10 15:05:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Deleting instance files /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28_del
Nov 10 15:05:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Deletion of /opt/stack/data/nova/instances/40c0bb3c-e83a-4d70-9299-a94c686cda28_del complete
Nov 10 15:05:02 user nova-compute[75703]: INFO nova.compute.manager [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 15:05:02 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:05:02 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-ef609593-29e0-4ac2-b21b-3d2722dda187 req-6ee99004-1964-4240-8404-395b4130c31f service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-vif-deleted-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:03 user nova-compute[75703]: INFO nova.compute.manager [req-ef609593-29e0-4ac2-b21b-3d2722dda187 req-6ee99004-1964-4240-8404-395b4130c31f service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Neutron deleted interface 53c7bac2-78b6-4148-836e-fd8c994d3d45; detaching it from the instance and deleting it from the info cache
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-ef609593-29e0-4ac2-b21b-3d2722dda187 req-6ee99004-1964-4240-8404-395b4130c31f service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-ef609593-29e0-4ac2-b21b-3d2722dda187 req-6ee99004-1964-4240-8404-395b4130c31f service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Detach interface failed, port_id=53c7bac2-78b6-4148-836e-fd8c994d3d45, reason: Instance 40c0bb3c-e83a-4d70-9299-a94c686cda28 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:05:03 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Took 0.56 seconds to deallocate network for instance.
Nov 10 15:05:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:05:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:03 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Deleted allocations for instance 40c0bb3c-e83a-4d70-9299-a94c686cda28
Nov 10 15:05:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d62f6738-36c5-4235-9180-6132f3f17c95 tempest-ServerBootFromVolumeStableRescueTest-2023657370 tempest-ServerBootFromVolumeStableRescueTest-2023657370-project-member] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-f7a852c2-06af-4684-b725-dda8501988ce req-7cdc1300-7816-4f77-9948-b06ab7bf6fb2 service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received event network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f7a852c2-06af-4684-b725-dda8501988ce req-7cdc1300-7816-4f77-9948-b06ab7bf6fb2 service nova] Acquiring lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f7a852c2-06af-4684-b725-dda8501988ce req-7cdc1300-7816-4f77-9948-b06ab7bf6fb2 service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f7a852c2-06af-4684-b725-dda8501988ce req-7cdc1300-7816-4f77-9948-b06ab7bf6fb2 service nova] Lock "40c0bb3c-e83a-4d70-9299-a94c686cda28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:04 user nova-compute[75703]: DEBUG nova.compute.manager [req-f7a852c2-06af-4684-b725-dda8501988ce req-7cdc1300-7816-4f77-9948-b06ab7bf6fb2 service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] No waiting events found dispatching network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:05:04 user nova-compute[75703]: WARNING nova.compute.manager [req-f7a852c2-06af-4684-b725-dda8501988ce req-7cdc1300-7816-4f77-9948-b06ab7bf6fb2 service nova] [instance: 40c0bb3c-e83a-4d70-9299-a94c686cda28] Received unexpected event network-vif-plugged-53c7bac2-78b6-4148-836e-fd8c994d3d45 for instance with vm_state deleted and task_state None.
Nov 10 15:05:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:05:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:12 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:05:12 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8010MB free_disk=24.981517791748047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance fa433bf7-2318-4dce-b293-b3907a7ab390 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a660d0a5-43a3-4ded-8176-316bf54c556a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:05:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:05:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:05:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:05:15 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updating instance_info_cache with network_info: [{"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-570421c8-0cd6-48fa-b3ee-87e60ac9e8df" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing instance network info cache due to event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updated VIF entry in instance network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG nova.network.neutron [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b8ac9a2-7913-44ef-af8a-ad52db35a33c req-fdfe4255-84f3-409c-a692-208bc6637c9d service nova] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:05:22 user nova-compute[75703]: INFO nova.compute.manager [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Detaching volume c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:05:23 user nova-compute[75703]: INFO nova.virt.block_device [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Attempting to driver detach volume c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 from mountpoint /dev/vdb
Nov 10 15:05:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Attempting to detach device vdb from instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:05:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:05:23 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:05:23 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:05:23 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:05:23 user nova-compute[75703]:   <serial>c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6</serial>
Nov 10 15:05:23 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:05:23 user nova-compute[75703]: </disk>
Nov 10 15:05:23 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:05:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully detached device vdb from instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 from the persistent domain config.
Nov 10 15:05:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:05:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:05:23 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:05:23 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:05:23 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:05:23 user nova-compute[75703]:   <serial>c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6</serial>
Nov 10 15:05:23 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:05:23 user nova-compute[75703]: </disk>
Nov 10 15:05:23 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:05:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG nova.compute.manager [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing instance network info cache due to event network-changed-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] Acquiring lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] Acquired lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG nova.network.neutron [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Refreshing network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG nova.network.neutron [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updated VIF entry in instance network info cache for port 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG nova.network.neutron [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [{"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:05:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4e3acade-c0f2-4850-8fda-f6cbcfef223b req-144d2d68-0a4c-4cbb-8d0c-34267645a0a6 service nova] Releasing lock "refresh_cache-b2a88db7-fb55-4fea-b1eb-b3550a8b3000" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:26 user nova-compute[75703]: INFO nova.compute.manager [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Terminating instance
Nov 10 15:05:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-a67372c7-f53c-4d0b-ac9f-f83334be85a3 req-03391cf1-babc-4151-b470-20b0184ad070 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-unplugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a67372c7-f53c-4d0b-ac9f-f83334be85a3 req-03391cf1-babc-4151-b470-20b0184ad070 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a67372c7-f53c-4d0b-ac9f-f83334be85a3 req-03391cf1-babc-4151-b470-20b0184ad070 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a67372c7-f53c-4d0b-ac9f-f83334be85a3 req-03391cf1-babc-4151-b470-20b0184ad070 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-a67372c7-f53c-4d0b-ac9f-f83334be85a3 req-03391cf1-babc-4151-b470-20b0184ad070 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-unplugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:05:26 user nova-compute[75703]: DEBUG nova.compute.manager [req-a67372c7-f53c-4d0b-ac9f-f83334be85a3 req-03391cf1-babc-4151-b470-20b0184ad070 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-unplugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Instance destroyed successfully.
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lazy-loading 'resources' on Instance uuid fa433bf7-2318-4dce-b293-b3907a7ab390 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-184206598',display_name='tempest-TestMinimumBasicScenario-server-184206598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-184206598',id=35,image_ref='0e09412e-7806-4340-a81b-d184c57341fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiQvXorGkVXxJ5nper0AW5yLmi7ga3Hz2aZ8j/dEZpCVrotQEMFA7rxmNCQTxeN4EuFv/du0zlRNk7HePqTRa2e9ZFkpDAnKTPUS4QqPg46Usay9fqTDLrT8Ua7JP+C9w==',key_name='tempest-TestMinimumBasicScenario-641668031',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22eaeb977349819aabde01a3b34930',ramdisk_id='',reservation_id='r-tpjdixlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0e09412e-7806-4340-a81b-d184c57341fb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-700348367',owner_user_name='tempest-TestMinimumBasicScenario-700348367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:02:38Z,user_data=None,user_id='bbf6ec70894948e4886371fc014fc732',uuid=fa433bf7-2318-4dce-b293-b3907a7ab390,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converting VIF {"id": "a5306b79-542a-42d1-b6bf-182c7265275b", "address": "fa:16:3e:3d:c9:5a", "network": {"id": "bb901752-778d-4291-8045-4df63950bf20", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2117950951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22eaeb977349819aabde01a3b34930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5306b79-54", "ovs_interfaceid": "a5306b79-542a-42d1-b6bf-182c7265275b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG os_vif [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5306b79-54, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6de02ec0-9b2d-4127-9eca-12d6d3fed700) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:27 user nova-compute[75703]: INFO os_vif [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:c9:5a,bridge_name='br-int',has_traffic_filtering=True,id=a5306b79-542a-42d1-b6bf-182c7265275b,network=Network(bb901752-778d-4291-8045-4df63950bf20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5306b79-54')
Nov 10 15:05:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Deleting instance files /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390_del
Nov 10 15:05:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Deletion of /opt/stack/data/nova/instances/fa433bf7-2318-4dce-b293-b3907a7ab390_del complete
Nov 10 15:05:27 user nova-compute[75703]: INFO nova.compute.manager [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 15:05:27 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:05:27 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:05:27 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Took 0.45 seconds to deallocate network for instance.
Nov 10 15:05:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:28 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:05:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:05:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:28 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Deleted allocations for instance fa433bf7-2318-4dce-b293-b3907a7ab390
Nov 10 15:05:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dab3fa60-71ed-4d72-b1e4-156aaac11ca5 tempest-TestMinimumBasicScenario-700348367 tempest-TestMinimumBasicScenario-700348367-project-member] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.779s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] Acquiring lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] Lock "fa433bf7-2318-4dce-b293-b3907a7ab390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] No waiting events found dispatching network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:05:29 user nova-compute[75703]: WARNING nova.compute.manager [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received unexpected event network-vif-plugged-a5306b79-542a-42d1-b6bf-182c7265275b for instance with vm_state deleted and task_state None.
Nov 10 15:05:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-e2938d84-637f-4080-b1ee-332943deb1d0 req-e1964953-1610-49c8-bb72-771359bd7ed8 service nova] [instance: fa433bf7-2318-4dce-b293-b3907a7ab390] Received event network-vif-deleted-a5306b79-542a-42d1-b6bf-182c7265275b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:43 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 is timed out.
Nov 10 15:05:43 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully detached device vdb from instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 from the live domain config.
Nov 10 15:05:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPJMACbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:05:43 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d080c5-c9c7-4990-9cd6-9eeff1f7979b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:05:43 user nova-compute[75703]: No targets found.
Nov 10 15:05:43 user nova-compute[75703]: iSNS:
Nov 10 15:05:43 user nova-compute[75703]: No targets found.
Nov 10 15:05:43 user nova-compute[75703]: STATIC:
Nov 10 15:05:43 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:05:43 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:05:43 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:05:43 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6
Nov 10 15:05:43 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:05:43 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:05:43 user nova-compute[75703]: FIRMWARE:
Nov 10 15:05:43 user nova-compute[75703]: No targets found.
Nov 10 15:05:43 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:05:43 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:05:43 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411c8db-abb3-4ca9-957e-5148a6911530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac9a57-a7a6-474e-8a75-ba2bca5267af]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:05:43 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:05:43 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 (non-flash)
Nov 10 15:05:43 user nova-compute[75703]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:05:43 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a42c32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9012f40-daa7-4e6b-9a2f-627a7f51d3af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f4e257-2fe1-4325-b17e-8fc794371d8b]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4895ca-248c-4427-be97-23c7d62ec1dd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e19dadf-497a-43fd-b6c6-3f57730bfb53]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e36329-d877-4e65-a16c-b50041d5087c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d673a5-99cb-4cce-89c0-28c89fb70978]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260]
Nov 10 15:05:43 user nova-compute[75703]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6, portal: 172.16.0.220,3260] successful.
Nov 10 15:05:43 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa47f1-7bcc-40e4-b1d4-bb522b6143d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c98f7e2-1dc3-46c5-9896-12baf55bd546]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] <== disconnect_volume: return (311ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:05:43 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:05:44 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'flavor' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:05:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1fa00685-1342-4eee-bfd2-f76f0f0c28fa tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:57 user nova-compute[75703]: INFO nova.compute.manager [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Terminating instance
Nov 10 15:05:57 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-26cf0410-e603-42a2-a0f8-a35163cc650e req-e0b8f4bd-f43a-4ca2-b2e5-71edb58d3340 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-unplugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-26cf0410-e603-42a2-a0f8-a35163cc650e req-e0b8f4bd-f43a-4ca2-b2e5-71edb58d3340 service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-26cf0410-e603-42a2-a0f8-a35163cc650e req-e0b8f4bd-f43a-4ca2-b2e5-71edb58d3340 service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-26cf0410-e603-42a2-a0f8-a35163cc650e req-e0b8f4bd-f43a-4ca2-b2e5-71edb58d3340 service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-26cf0410-e603-42a2-a0f8-a35163cc650e req-e0b8f4bd-f43a-4ca2-b2e5-71edb58d3340 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-unplugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-26cf0410-e603-42a2-a0f8-a35163cc650e req-e0b8f4bd-f43a-4ca2-b2e5-71edb58d3340 service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-unplugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Instance destroyed successfully.
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.objects.instance [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'resources' on Instance uuid a660d0a5-43a3-4ded-8176-316bf54c556a {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2099456931',display_name='tempest-ServerActionsTestOtherA-server-2099456931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2099456931',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:01:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-fcv3dmop',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=a660d0a5-43a3-4ded-8176-316bf54c556a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "76e9185b-15b2-42d6-a80f-b57c6d226695", "address": "fa:16:3e:67:61:80", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e9185b-15", "ovs_interfaceid": "76e9185b-15b2-42d6-a80f-b57c6d226695", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_vif [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76e9185b-15, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96719e2e-9c8e-44e2-92b7-2ad41eb416e9) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:05:58 user nova-compute[75703]: INFO os_vif [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:61:80,bridge_name='br-int',has_traffic_filtering=True,id=76e9185b-15b2-42d6-a80f-b57c6d226695,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e9185b-15')
Nov 10 15:05:58 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrTIqMny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:05:58 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594e42f-3f52-473e-8bf2-9c06df01d21f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:05:58 user nova-compute[75703]: No targets found.
Nov 10 15:05:58 user nova-compute[75703]: iSNS:
Nov 10 15:05:58 user nova-compute[75703]: No targets found.
Nov 10 15:05:58 user nova-compute[75703]: STATIC:
Nov 10 15:05:58 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4
Nov 10 15:05:58 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:05:58 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:05:58 user nova-compute[75703]: FIRMWARE:
Nov 10 15:05:58 user nova-compute[75703]: No targets found.
Nov 10 15:05:58 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:05:58 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:05:58 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[016bc21f-a449-4cf4-95ef-06c5bd3df788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91be79-76a1-4cf1-be2d-bc90546a1cb5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:05:58 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 (non-flash)
Nov 10 15:05:58 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a42c1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4'): ({'sde'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Removing single pathed devices sde {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce7ff8a-ea68-4672-8b59-cd286720e5c2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad5c3e-1318-448a-8df2-0f064c644583]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Flushing IO for device /dev/sde {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6795b2e9-cf93-48fa-a859-5adf05aec5ae]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:05:58 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[643dbc86-857d-4184-be2f-01fa36888ea7]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26462353565643064', '/dev/disk/by-id/scsi-1SCST_BIOcee24e71-db55ed0d28cb2eb6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cee24e71') {{(pid=87268) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c7df8b-58f6-4f54-b04f-2e724110ade0]: (4, None) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef822888-100c-4cba-a5dc-4708a79eb3ec]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75b7a09-d991-4255-bc39-71be2fe3d233]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260]
Nov 10 15:05:59 user nova-compute[75703]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4, portal: 172.16.0.220,3260] successful.
Nov 10 15:05:59 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5a52271-1341-407f-996d-95c580acc6b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ee2bcb-8863-46fc-b640-4b13ed72ca94]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.495s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] <== disconnect_volume: return (497ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:05:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Deleting instance files /opt/stack/data/nova/instances/a660d0a5-43a3-4ded-8176-316bf54c556a_del
Nov 10 15:05:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Deletion of /opt/stack/data/nova/instances/a660d0a5-43a3-4ded-8176-316bf54c556a_del complete
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:59 user nova-compute[75703]: INFO nova.compute.manager [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Unshelving
Nov 10 15:05:59 user nova-compute[75703]: INFO nova.compute.manager [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'pci_requests' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:05:59 user nova-compute[75703]: INFO nova.compute.claims [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Claim successful on node user
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:05:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:05:59 user nova-compute[75703]: INFO nova.network.neutron [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating port e2570295-7c57-4c22-b9da-911adf6fe0b7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:00 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Took 0.95 seconds to deallocate network for instance.
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-be473a1c-95b0-45ad-9124-9299b58d58b1 req-250be343-9812-4dc8-92cf-6993bfa4d96e service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-deleted-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-157416f0-b9fe-4803-897f-6868f9676a6b req-4b7033aa-bd6a-4713-806e-1d28e704675d service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-157416f0-b9fe-4803-897f-6868f9676a6b req-4b7033aa-bd6a-4713-806e-1d28e704675d service nova] Acquiring lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-157416f0-b9fe-4803-897f-6868f9676a6b req-4b7033aa-bd6a-4713-806e-1d28e704675d service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-157416f0-b9fe-4803-897f-6868f9676a6b req-4b7033aa-bd6a-4713-806e-1d28e704675d service nova] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-157416f0-b9fe-4803-897f-6868f9676a6b req-4b7033aa-bd6a-4713-806e-1d28e704675d service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] No waiting events found dispatching network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:00 user nova-compute[75703]: WARNING nova.compute.manager [req-157416f0-b9fe-4803-897f-6868f9676a6b req-4b7033aa-bd6a-4713-806e-1d28e704675d service nova] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Received unexpected event network-vif-plugged-76e9185b-15b2-42d6-a80f-b57c6d226695 for instance with vm_state active and task_state deleting.
Nov 10 15:06:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquired lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-changed-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG nova.compute.manager [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Refreshing instance network info cache due to event network-changed-e2570295-7c57-4c22-b9da-911adf6fe0b7. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:06:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] Acquiring lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:01 user nova-compute[75703]: INFO nova.compute.manager [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Took 1.26 seconds to detach 1 volumes for instance.
Nov 10 15:06:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: a660d0a5-43a3-4ded-8176-316bf54c556a] Deleting volume: a5a52271-1341-407f-996d-95c580acc6b4 {{(pid=75703) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Releasing lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:06:01 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Creating image(s)
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] Acquired lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG nova.network.neutron [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Refreshing network info cache for port e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG nova.objects.base [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Object Instance<3c2c4c67-ae89-40fb-896e-adad9aab8847> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.part --force-share --output=json" returned: 0 in 0.282s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG nova.virt.images [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] 83a93182-1a61-44db-a08c-be4bc99723c1 was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.part /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updated VIF entry in instance network info cache for port e2570295-7c57-4c22-b9da-911adf6fe0b7. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-861ecd4e-9e06-4cca-8edf-de11d98d2251 req-bfa13cda-bba8-4e7a-b8c2-1dfb7d52c251 service nova] Releasing lock "refresh_cache-3c2c4c67-ae89-40fb-896e-adad9aab8847" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.858s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:03 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Deleted allocations for instance a660d0a5-43a3-4ded-8176-316bf54c556a
Nov 10 15:06:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.part /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.converted" returned: 0 in 0.906s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:03 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b0477fef-73a0-4187-92a1-616182076b23 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "a660d0a5-43a3-4ded-8176-316bf54c556a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.255s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:06:04 user nova-compute[75703]: INFO nova.compute.claims [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Claim successful on node user
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.718s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 --force-share --output=json" returned: 0 in 0.269s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 --force-share --output=json" returned: 0 in 0.252s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40,backing_fmt=raw /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40,backing_fmt=raw /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk 1073741824" returned: 0 in 0.083s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:06:04 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:06:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:06:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG nova.policy [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67a5a4845f164d8cba0951d82f2430e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c013cf84f8b414ba6d2d888ddc2ee1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 --force-share --output=json" returned: 0 in 0.245s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'migration_context' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG nova.objects.base [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Object Instance<3c2c4c67-ae89-40fb-896e-adad9aab8847> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:06:05 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Rebasing disk image.
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: INFO nova.virt.block_device [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Booting with volume b0779f06-151c-4e63-8364-417c1d24fbf7 at /dev/vda
Nov 10 15:06:05 user nova-compute[75703]: DEBUG os_brick.utils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf058f-c5ec-45d6-acb2-809eb55617bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0439cf06-5cea-4efe-b703-79c2a239111c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.209s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef -F raw /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad350095-ad50-4f4f-a6f4-c3a2c4b05de3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9da9c-45a6-4f17-b496-c66533cd22e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:06:05 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:06:05 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f7dbd-0a8e-41fa-99af-4c3f325f17a9]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG os_brick.utils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:06:05 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updating existing volume attachment record: 013366be-3fcb-4e0b-8f41-9e918988f528 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:06:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Successfully created port: d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:06:06 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Successfully updated port: d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-changed-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.compute.manager [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Refreshing instance network info cache due to event network-changed-d3b3285a-13fa-492d-9437-478271ca2e27. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] Acquiring lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] Acquired lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.network.neutron [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Refreshing network info cache for port d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.network.neutron [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.network.neutron [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7bde5166-fbbb-4ed4-9261-be52f7ae38d9 req-b9e5df12-6d52-4291-8ffe-c67ae57bb155 service nova] Releasing lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquired lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.network.neutron [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updating instance_info_cache with network_info: [{"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Releasing lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Instance network_info: |[{"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef -F raw /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk" returned: 0 in 2.810s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Ensure instance console log exists: /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Start _get_guest_xml network_info=[{"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f4bf7a195726789868cc23e76057e994',container_format='bare',created_at=2023-11-10T15:04:06Z,direct_url=<?>,disk_format='qcow2',id=83a93182-1a61-44db-a08c-be4bc99723c1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-126003728-shelved',owner='baf2404e273a4409ae3a1bb5d57eed08',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T15:04:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:06:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:08 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f4bf7a195726789868cc23e76057e994',container_format='bare',created_at=2023-11-10T15:04:06Z,direct_url=<?>,disk_format='qcow2',id=83a93182-1a61-44db-a08c-be4bc99723c1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-126003728-shelved',owner='baf2404e273a4409ae3a1bb5d57eed08',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T15:04:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.objects.base [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Object Instance<3c2c4c67-ae89-40fb-896e-adad9aab8847> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126003728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126003728',id=39,image_ref='83a93182-1a61-44db-a08c-be4bc99723c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1081069009',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-q6163v6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member',shelved_at='2023-11-10T15:04:10.532746',shelved_host='user',shelved_image_id='83a93182-1a61-44db-a08c-be4bc99723c1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=3c2c4c67-ae89-40fb-896e-adad9aab8847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.objects.instance [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.objects.base [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Object Instance<3c2c4c67-ae89-40fb-896e-adad9aab8847> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75703) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:06:08 user nova-compute[75703]:   <uuid>3c2c4c67-ae89-40fb-896e-adad9aab8847</uuid>
Nov 10 15:06:08 user nova-compute[75703]:   <name>instance-00000027</name>
Nov 10 15:06:08 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:06:08 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:06:08 user nova-compute[75703]:   <metadata>
Nov 10 15:06:08 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:06:08 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:06:08 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-126003728</nova:name>
Nov 10 15:06:08 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:06:08</nova:creationTime>
Nov 10 15:06:08 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:06:08 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:06:08 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:06:08 user nova-compute[75703]:       <nova:owner>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:user uuid="37caa38086ae47a0be1d7f6f6a5aa6d6">tempest-AttachVolumeShelveTestJSON-2134379644-project-member</nova:user>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:project uuid="baf2404e273a4409ae3a1bb5d57eed08">tempest-AttachVolumeShelveTestJSON-2134379644</nova:project>
Nov 10 15:06:08 user nova-compute[75703]:       </nova:owner>
Nov 10 15:06:08 user nova-compute[75703]:       <nova:root type="image" uuid="83a93182-1a61-44db-a08c-be4bc99723c1"/>
Nov 10 15:06:08 user nova-compute[75703]:       <nova:ports>
Nov 10 15:06:08 user nova-compute[75703]:         <nova:port uuid="e2570295-7c57-4c22-b9da-911adf6fe0b7">
Nov 10 15:06:08 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 15:06:08 user nova-compute[75703]:         </nova:port>
Nov 10 15:06:08 user nova-compute[75703]:       </nova:ports>
Nov 10 15:06:08 user nova-compute[75703]:     </nova:instance>
Nov 10 15:06:08 user nova-compute[75703]:   </metadata>
Nov 10 15:06:08 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:06:08 user nova-compute[75703]:     <system>
Nov 10 15:06:08 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:06:08 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:06:08 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:06:08 user nova-compute[75703]:       <entry name="serial">3c2c4c67-ae89-40fb-896e-adad9aab8847</entry>
Nov 10 15:06:08 user nova-compute[75703]:       <entry name="uuid">3c2c4c67-ae89-40fb-896e-adad9aab8847</entry>
Nov 10 15:06:08 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:06:08 user nova-compute[75703]:     </system>
Nov 10 15:06:08 user nova-compute[75703]:   </sysinfo>
Nov 10 15:06:08 user nova-compute[75703]:   <os>
Nov 10 15:06:08 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:06:08 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:06:08 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:06:08 user nova-compute[75703]:   </os>
Nov 10 15:06:08 user nova-compute[75703]:   <features>
Nov 10 15:06:08 user nova-compute[75703]:     <acpi/>
Nov 10 15:06:08 user nova-compute[75703]:     <apic/>
Nov 10 15:06:08 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:06:08 user nova-compute[75703]:   </features>
Nov 10 15:06:08 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:06:08 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:06:08 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:06:08 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:06:08 user nova-compute[75703]:   </clock>
Nov 10 15:06:08 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:06:08 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:06:08 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:06:08 user nova-compute[75703]:   </cpu>
Nov 10 15:06:08 user nova-compute[75703]:   <devices>
Nov 10 15:06:08 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:06:08 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:06:08 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk"/>
Nov 10 15:06:08 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:06:08 user nova-compute[75703]:     </disk>
Nov 10 15:06:08 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:06:08 user nova-compute[75703]:       <mac address="fa:16:3e:83:87:55"/>
Nov 10 15:06:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:08 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:06:08 user nova-compute[75703]:       <target dev="tape2570295-7c"/>
Nov 10 15:06:08 user nova-compute[75703]:     </interface>
Nov 10 15:06:08 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:06:08 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/console.log" append="off"/>
Nov 10 15:06:08 user nova-compute[75703]:     </serial>
Nov 10 15:06:08 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:06:08 user nova-compute[75703]:     <video>
Nov 10 15:06:08 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:08 user nova-compute[75703]:     </video>
Nov 10 15:06:08 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:06:08 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:06:08 user nova-compute[75703]:     </rng>
Nov 10 15:06:08 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:06:08 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:06:08 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:06:08 user nova-compute[75703]:     </memballoon>
Nov 10 15:06:08 user nova-compute[75703]:   </devices>
Nov 10 15:06:08 user nova-compute[75703]: </domain>
Nov 10 15:06:08 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126003728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126003728',id=39,image_ref='83a93182-1a61-44db-a08c-be4bc99723c1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1081069009',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-q6163v6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member',shelved_at='2023-11-10T15:04:10.532746',shelved_host='user',shelved_image_id='83a93182-1a61-44db-a08c-be4bc99723c1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=3c2c4c67-ae89-40fb-896e-adad9aab8847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG os_vif [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9deb79a-a199-5891-9cb9-79f54ae55649', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2570295-7c, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2570295-7c, col_values=(('qos', UUID('772415f7-42d0-4c01-936e-9b4869124106')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2570295-7c, col_values=(('external_ids', {'iface-id': 'e2570295-7c57-4c22-b9da-911adf6fe0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:87:55', 'vm-uuid': '3c2c4c67-ae89-40fb-896e-adad9aab8847'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:08 user nova-compute[75703]: INFO os_vif [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c')
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:06:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] No VIF found with MAC fa:16:3e:83:87:55, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-b3ea3467-9268-43a2-a0dc-8a1d1c2d9daf req-31702591-b3d4-4822-bf63-fcbb405dfe8e service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b3ea3467-9268-43a2-a0dc-8a1d1c2d9daf req-31702591-b3d4-4822-bf63-fcbb405dfe8e service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b3ea3467-9268-43a2-a0dc-8a1d1c2d9daf req-31702591-b3d4-4822-bf63-fcbb405dfe8e service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b3ea3467-9268-43a2-a0dc-8a1d1c2d9daf req-31702591-b3d4-4822-bf63-fcbb405dfe8e service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-b3ea3467-9268-43a2-a0dc-8a1d1c2d9daf req-31702591-b3d4-4822-bf63-fcbb405dfe8e service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:10 user nova-compute[75703]: WARNING nova.compute.manager [req-b3ea3467-9268-43a2-a0dc-8a1d1c2d9daf req-31702591-b3d4-4822-bf63-fcbb405dfe8e service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 15:06:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:06:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-774badfa-3af9-4532-9e60-9caf27cec551 req-9eff5678-c9a2-4292-a472-06a6eed2e7c7 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-774badfa-3af9-4532-9e60-9caf27cec551 req-9eff5678-c9a2-4292-a472-06a6eed2e7c7 service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-774badfa-3af9-4532-9e60-9caf27cec551 req-9eff5678-c9a2-4292-a472-06a6eed2e7c7 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-774badfa-3af9-4532-9e60-9caf27cec551 req-9eff5678-c9a2-4292-a472-06a6eed2e7c7 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-774badfa-3af9-4532-9e60-9caf27cec551 req-9eff5678-c9a2-4292-a472-06a6eed2e7c7 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:12 user nova-compute[75703]: WARNING nova.compute.manager [req-774badfa-3af9-4532-9e60-9caf27cec551 req-9eff5678-c9a2-4292-a472-06a6eed2e7c7 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:06:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:06:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance spawned successfully.
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-dbc3d984-30ab-4b46-93c0-e6c27e29be27 tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.358s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:14 user nova-compute[75703]: INFO nova.compute.manager [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Terminating instance
Nov 10 15:06:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-16d61f61-da25-4cb1-9b42-6a74352061c7 req-616306cd-db3c-4e27-add4-807721c730a3 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-16d61f61-da25-4cb1-9b42-6a74352061c7 req-616306cd-db3c-4e27-add4-807721c730a3 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-16d61f61-da25-4cb1-9b42-6a74352061c7 req-616306cd-db3c-4e27-add4-807721c730a3 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-16d61f61-da25-4cb1-9b42-6a74352061c7 req-616306cd-db3c-4e27-add4-807721c730a3 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-16d61f61-da25-4cb1-9b42-6a74352061c7 req-616306cd-db3c-4e27-add4-807721c730a3 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-16d61f61-da25-4cb1-9b42-6a74352061c7 req-616306cd-db3c-4e27-add4-807721c730a3 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-unplugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:15 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:15 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8246MB free_disk=24.87352752685547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Instance destroyed successfully.
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'resources' on Instance uuid b2a88db7-fb55-4fea-b1eb-b3550a8b3000 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2033951572',display_name='tempest-ServerRescueNegativeTestJSON-server-2033951572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2033951572',id=32,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwrLMbJcntOzGAehkzazcvpfUoRQDHzTSvqbBpVmgdiRUE6OVIDvi4D6P4wplVbIfblCWp6TcYTE9WI0uNMtZj4CyCCGXODKrPYHowANO1Ca63O0oj8e+1JgCv1jxCWqg==',key_name='tempest-keypair-108299880',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-50ne7ebz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=b2a88db7-fb55-4fea-b1eb-b3550a8b3000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "address": "fa:16:3e:00:c8:85", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6b5d1a-ff", "ovs_interfaceid": "3e6b5d1a-ff60-4a01-928b-e3ce75ec6875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG os_vif [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e6b5d1a-ff, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=347d370d-2e22-4eae-bd5f-2fcfb59c3a5a) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:15 user nova-compute[75703]: INFO os_vif [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:85,bridge_name='br-int',has_traffic_filtering=True,id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e6b5d1a-ff')
Nov 10 15:06:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Deleting instance files /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000_del
Nov 10 15:06:15 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Deletion of /opt/stack/data/nova/instances/b2a88db7-fb55-4fea-b1eb-b3550a8b3000_del complete
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 3c2c4c67-ae89-40fb-896e-adad9aab8847 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance da3f48e7-be1a-4a4a-89f9-343c394ad7d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:06:15 user nova-compute[75703]: INFO nova.compute.manager [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 10 15:06:15 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:06:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:16 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Took 0.87 seconds to deallocate network for instance.
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-44ecf7bd-7aad-4270-b48d-83c5b7e7db8d req-e5857fb5-e034-4671-b202-81f329be3a5f service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-deleted-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:16 user nova-compute[75703]: INFO nova.compute.manager [req-44ecf7bd-7aad-4270-b48d-83c5b7e7db8d req-e5857fb5-e034-4671-b202-81f329be3a5f service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Neutron deleted interface 3e6b5d1a-ff60-4a01-928b-e3ce75ec6875; detaching it from the instance and deleting it from the info cache
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.network.neutron [req-44ecf7bd-7aad-4270-b48d-83c5b7e7db8d req-e5857fb5-e034-4671-b202-81f329be3a5f service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-44ecf7bd-7aad-4270-b48d-83c5b7e7db8d req-e5857fb5-e034-4671-b202-81f329be3a5f service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Detach interface failed, port_id=3e6b5d1a-ff60-4a01-928b-e3ce75ec6875, reason: Instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-f7991fbe-65a7-4cd7-9185-9c0c7622babe req-62660f1a-be3f-4cf9-baf0-6d277becaae7 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f7991fbe-65a7-4cd7-9185-9c0c7622babe req-62660f1a-be3f-4cf9-baf0-6d277becaae7 service nova] Acquiring lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f7991fbe-65a7-4cd7-9185-9c0c7622babe req-62660f1a-be3f-4cf9-baf0-6d277becaae7 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f7991fbe-65a7-4cd7-9185-9c0c7622babe req-62660f1a-be3f-4cf9-baf0-6d277becaae7 service nova] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.compute.manager [req-f7991fbe-65a7-4cd7-9185-9c0c7622babe req-62660f1a-be3f-4cf9-baf0-6d277becaae7 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] No waiting events found dispatching network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:16 user nova-compute[75703]: WARNING nova.compute.manager [req-f7991fbe-65a7-4cd7-9185-9c0c7622babe req-62660f1a-be3f-4cf9-baf0-6d277becaae7 service nova] [instance: b2a88db7-fb55-4fea-b1eb-b3550a8b3000] Received unexpected event network-vif-plugged-3e6b5d1a-ff60-4a01-928b-e3ce75ec6875 for instance with vm_state deleted and task_state None.
Nov 10 15:06:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:06:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:16 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Deleted allocations for instance b2a88db7-fb55-4fea-b1eb-b3550a8b3000
Nov 10 15:06:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d3c49afe-fbc0-42e7-990c-274fdce2de15 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "b2a88db7-fb55-4fea-b1eb-b3550a8b3000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.083s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:06:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:06:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:06:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:06:28 user nova-compute[75703]: INFO nova.compute.claims [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Claim successful on node user
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:06:29 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.policy [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13372a749c2c414592ead6ec55b1d600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe4c168e5b4444cad4c108505dfe149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:06:29 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Creating image(s)
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "/opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "/opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "/opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.223s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.225s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk 1073741824" returned: 0 in 0.061s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Successfully created port: a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Cannot resize image /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Ensure instance console log exists: /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Successfully updated port: a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquired lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-changed-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Refreshing instance network info cache due to event network-changed-a38f91e0-0b90-458b-b353-1372ab98662b. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] Acquiring lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.neutron [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Updating instance_info_cache with network_info: [{"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Releasing lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Instance network_info: |[{"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] Acquired lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.neutron [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Refreshing network info cache for port a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Start _get_guest_xml network_info=[{"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:06:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-215386609',display_name='tempest-VolumesActionsTest-instance-215386609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-215386609',id=41,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fe4c168e5b4444cad4c108505dfe149',ramdisk_id='',reservation_id='r-ys0no5my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-292125102',owner_user_name='tempest-VolumesActionsTest-292125102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:06:29Z,user_data=None,user_id='13372a749c2c414592ead6ec55b1d600',uuid=70b2c4ac-9aa6-459a-90b4-3c743e2efa4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Converting VIF {"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lazy-loading 'pci_devices' on Instance uuid 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:06:31 user nova-compute[75703]:   <uuid>70b2c4ac-9aa6-459a-90b4-3c743e2efa4b</uuid>
Nov 10 15:06:31 user nova-compute[75703]:   <name>instance-00000029</name>
Nov 10 15:06:31 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:06:31 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:06:31 user nova-compute[75703]:   <metadata>
Nov 10 15:06:31 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:06:31 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:06:31 user nova-compute[75703]:       <nova:name>tempest-VolumesActionsTest-instance-215386609</nova:name>
Nov 10 15:06:31 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:06:31</nova:creationTime>
Nov 10 15:06:31 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:06:31 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:06:31 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:06:31 user nova-compute[75703]:       <nova:owner>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:user uuid="13372a749c2c414592ead6ec55b1d600">tempest-VolumesActionsTest-292125102-project-member</nova:user>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:project uuid="1fe4c168e5b4444cad4c108505dfe149">tempest-VolumesActionsTest-292125102</nova:project>
Nov 10 15:06:31 user nova-compute[75703]:       </nova:owner>
Nov 10 15:06:31 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:06:31 user nova-compute[75703]:       <nova:ports>
Nov 10 15:06:31 user nova-compute[75703]:         <nova:port uuid="a38f91e0-0b90-458b-b353-1372ab98662b">
Nov 10 15:06:31 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 15:06:31 user nova-compute[75703]:         </nova:port>
Nov 10 15:06:31 user nova-compute[75703]:       </nova:ports>
Nov 10 15:06:31 user nova-compute[75703]:     </nova:instance>
Nov 10 15:06:31 user nova-compute[75703]:   </metadata>
Nov 10 15:06:31 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:06:31 user nova-compute[75703]:     <system>
Nov 10 15:06:31 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:06:31 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:06:31 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:06:31 user nova-compute[75703]:       <entry name="serial">70b2c4ac-9aa6-459a-90b4-3c743e2efa4b</entry>
Nov 10 15:06:31 user nova-compute[75703]:       <entry name="uuid">70b2c4ac-9aa6-459a-90b4-3c743e2efa4b</entry>
Nov 10 15:06:31 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:06:31 user nova-compute[75703]:     </system>
Nov 10 15:06:31 user nova-compute[75703]:   </sysinfo>
Nov 10 15:06:31 user nova-compute[75703]:   <os>
Nov 10 15:06:31 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:06:31 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:06:31 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:06:31 user nova-compute[75703]:   </os>
Nov 10 15:06:31 user nova-compute[75703]:   <features>
Nov 10 15:06:31 user nova-compute[75703]:     <acpi/>
Nov 10 15:06:31 user nova-compute[75703]:     <apic/>
Nov 10 15:06:31 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:06:31 user nova-compute[75703]:   </features>
Nov 10 15:06:31 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:06:31 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:06:31 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:06:31 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:06:31 user nova-compute[75703]:   </clock>
Nov 10 15:06:31 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:06:31 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:06:31 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:06:31 user nova-compute[75703]:   </cpu>
Nov 10 15:06:31 user nova-compute[75703]:   <devices>
Nov 10 15:06:31 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:06:31 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:06:31 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk"/>
Nov 10 15:06:31 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:06:31 user nova-compute[75703]:     </disk>
Nov 10 15:06:31 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:06:31 user nova-compute[75703]:       <mac address="fa:16:3e:86:af:c4"/>
Nov 10 15:06:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:31 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:06:31 user nova-compute[75703]:       <target dev="tapa38f91e0-0b"/>
Nov 10 15:06:31 user nova-compute[75703]:     </interface>
Nov 10 15:06:31 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:06:31 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/console.log" append="off"/>
Nov 10 15:06:31 user nova-compute[75703]:     </serial>
Nov 10 15:06:31 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:06:31 user nova-compute[75703]:     <video>
Nov 10 15:06:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:31 user nova-compute[75703]:     </video>
Nov 10 15:06:31 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:06:31 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:06:31 user nova-compute[75703]:     </rng>
Nov 10 15:06:31 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:06:31 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:06:31 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:06:31 user nova-compute[75703]:     </memballoon>
Nov 10 15:06:31 user nova-compute[75703]:   </devices>
Nov 10 15:06:31 user nova-compute[75703]: </domain>
Nov 10 15:06:31 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-215386609',display_name='tempest-VolumesActionsTest-instance-215386609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-215386609',id=41,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fe4c168e5b4444cad4c108505dfe149',ramdisk_id='',reservation_id='r-ys0no5my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-292125102',owner_user_name='tempest-VolumesActionsTest-292125102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:06:29Z,user_data=None,user_id='13372a749c2c414592ead6ec55b1d600',uuid=70b2c4ac-9aa6-459a-90b4-3c743e2efa4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Converting VIF {"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG os_vif [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc715053-8435-58e5-b935-e369330dae12', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa38f91e0-0b, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa38f91e0-0b, col_values=(('qos', UUID('6f30b28f-745d-4ce9-924a-40d2b262c5d9')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa38f91e0-0b, col_values=(('external_ids', {'iface-id': 'a38f91e0-0b90-458b-b353-1372ab98662b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:af:c4', 'vm-uuid': '70b2c4ac-9aa6-459a-90b4-3c743e2efa4b'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:31 user nova-compute[75703]: INFO os_vif [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b')
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:06:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] No VIF found with MAC fa:16:3e:86:af:c4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:06:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Updated VIF entry in instance network info cache for port a38f91e0-0b90-458b-b353-1372ab98662b. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:06:32 user nova-compute[75703]: DEBUG nova.network.neutron [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Updating instance_info_cache with network_info: [{"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-2d07223d-87a9-40cf-804e-1f087cc13748 req-bcee2e4d-c023-42ce-a326-eb70ebf58bbe service nova] Releasing lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:06:33 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Creating image(s)
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Ensure instance console log exists: /opt/stack/data/nova/instances/da3f48e7-be1a-4a4a-89f9-343c394ad7d4/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Start _get_guest_xml network_info=[{"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '013366be-3fcb-4e0b-8f41-9e918988f528', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da3f48e7-be1a-4a4a-89f9-343c394ad7d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0779f06-151c-4e63-8364-417c1d24fbf7', 'serial': 'b0779f06-151c-4e63-8364-417c1d24fbf7'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:06:33 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:06:33 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:06:33 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72285bd-f126-4cd5-84d8-f6aa955194eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:06:33 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[02666e48-2b4c-4a7f-b50b-377c7d5c3eee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7] added
Nov 10 15:06:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[50755122-f7a8-4dfd-8f40-6f5d6f5a91b3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-f2f2eec4-e176-42fe-b3cd-e439ff0a52e1 req-5f3a8fcf-e36e-4f25-b3a3-0696bc393c03 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f2f2eec4-e176-42fe-b3cd-e439ff0a52e1 req-5f3a8fcf-e36e-4f25-b3a3-0696bc393c03 service nova] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f2f2eec4-e176-42fe-b3cd-e439ff0a52e1 req-5f3a8fcf-e36e-4f25-b3a3-0696bc393c03 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f2f2eec4-e176-42fe-b3cd-e439ff0a52e1 req-5f3a8fcf-e36e-4f25-b3a3-0696bc393c03 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-f2f2eec4-e176-42fe-b3cd-e439ff0a52e1 req-5f3a8fcf-e36e-4f25-b3a3-0696bc393c03 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] No waiting events found dispatching network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:33 user nova-compute[75703]: WARNING nova.compute.manager [req-f2f2eec4-e176-42fe-b3cd-e439ff0a52e1 req-5f3a8fcf-e36e-4f25-b3a3-0696bc393c03 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received unexpected event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b for instance with vm_state building and task_state spawning.
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b28c1-0210-4f8f-8692-fb9a4726bf74]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJGsQLlF {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJGsQLlF" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c07dec-19fe-4feb-94c2-135bad30c4cc]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aJGsQLlF'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd3b7fd-979f-4bef-81d2-f5b3e4a3eb02]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53aaf59-8fcf-4ca2-af41-c6769e6704ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:06:33 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:06:33 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:06:33 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:06:33 user nova-compute[75703]: 
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cb9b03-abf7-4da8-a239-5980065269a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]
Nov 10 15:06:33 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.
Nov 10 15:06:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d4b80b-388a-4c34-a635-a98563bb3791]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daa48c5-f3c5-4c30-9b21-68d73159506a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:06:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:06:33 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cf552-0d0d-40fe-909f-7f93a8471617]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23861623864643330', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861623864643330', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2017438909',display_name='tempest-TestVolumeBootPattern-server-2017438909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2017438909',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-nnzzy5tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:06:05Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=da3f48e7-be1a-4a4a-89f9-343c394ad7d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.objects.instance [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'pci_devices' on Instance uuid da3f48e7-be1a-4a4a-89f9-343c394ad7d4 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:06:34 user nova-compute[75703]:   <uuid>da3f48e7-be1a-4a4a-89f9-343c394ad7d4</uuid>
Nov 10 15:06:34 user nova-compute[75703]:   <name>instance-00000028</name>
Nov 10 15:06:34 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:06:34 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:06:34 user nova-compute[75703]:   <metadata>
Nov 10 15:06:34 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:06:34 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:06:34 user nova-compute[75703]:       <nova:name>tempest-TestVolumeBootPattern-server-2017438909</nova:name>
Nov 10 15:06:34 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:06:33</nova:creationTime>
Nov 10 15:06:34 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:06:34 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:06:34 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:06:34 user nova-compute[75703]:       <nova:owner>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:user uuid="67a5a4845f164d8cba0951d82f2430e9">tempest-TestVolumeBootPattern-982390102-project-member</nova:user>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:project uuid="3c013cf84f8b414ba6d2d888ddc2ee1b">tempest-TestVolumeBootPattern-982390102</nova:project>
Nov 10 15:06:34 user nova-compute[75703]:       </nova:owner>
Nov 10 15:06:34 user nova-compute[75703]:       <nova:ports>
Nov 10 15:06:34 user nova-compute[75703]:         <nova:port uuid="d3b3285a-13fa-492d-9437-478271ca2e27">
Nov 10 15:06:34 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 15:06:34 user nova-compute[75703]:         </nova:port>
Nov 10 15:06:34 user nova-compute[75703]:       </nova:ports>
Nov 10 15:06:34 user nova-compute[75703]:     </nova:instance>
Nov 10 15:06:34 user nova-compute[75703]:   </metadata>
Nov 10 15:06:34 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:06:34 user nova-compute[75703]:     <system>
Nov 10 15:06:34 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:06:34 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:06:34 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:06:34 user nova-compute[75703]:       <entry name="serial">da3f48e7-be1a-4a4a-89f9-343c394ad7d4</entry>
Nov 10 15:06:34 user nova-compute[75703]:       <entry name="uuid">da3f48e7-be1a-4a4a-89f9-343c394ad7d4</entry>
Nov 10 15:06:34 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:06:34 user nova-compute[75703]:     </system>
Nov 10 15:06:34 user nova-compute[75703]:   </sysinfo>
Nov 10 15:06:34 user nova-compute[75703]:   <os>
Nov 10 15:06:34 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:06:34 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:06:34 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:06:34 user nova-compute[75703]:   </os>
Nov 10 15:06:34 user nova-compute[75703]:   <features>
Nov 10 15:06:34 user nova-compute[75703]:     <acpi/>
Nov 10 15:06:34 user nova-compute[75703]:     <apic/>
Nov 10 15:06:34 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:06:34 user nova-compute[75703]:   </features>
Nov 10 15:06:34 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:06:34 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:06:34 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:06:34 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:06:34 user nova-compute[75703]:   </clock>
Nov 10 15:06:34 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:06:34 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:06:34 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:06:34 user nova-compute[75703]:   </cpu>
Nov 10 15:06:34 user nova-compute[75703]:   <devices>
Nov 10 15:06:34 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 15:06:34 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:06:34 user nova-compute[75703]:       <source dev="/dev/sdb"/>
Nov 10 15:06:34 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:06:34 user nova-compute[75703]:       <serial>b0779f06-151c-4e63-8364-417c1d24fbf7</serial>
Nov 10 15:06:34 user nova-compute[75703]:     </disk>
Nov 10 15:06:34 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:06:34 user nova-compute[75703]:       <mac address="fa:16:3e:7f:fb:39"/>
Nov 10 15:06:34 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:34 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:06:34 user nova-compute[75703]:       <target dev="tapd3b3285a-13"/>
Nov 10 15:06:34 user nova-compute[75703]:     </interface>
Nov 10 15:06:34 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:06:34 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/da3f48e7-be1a-4a4a-89f9-343c394ad7d4/console.log" append="off"/>
Nov 10 15:06:34 user nova-compute[75703]:     </serial>
Nov 10 15:06:34 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:06:34 user nova-compute[75703]:     <video>
Nov 10 15:06:34 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:34 user nova-compute[75703]:     </video>
Nov 10 15:06:34 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:06:34 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:06:34 user nova-compute[75703]:     </rng>
Nov 10 15:06:34 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:06:34 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:06:34 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:06:34 user nova-compute[75703]:     </memballoon>
Nov 10 15:06:34 user nova-compute[75703]:   </devices>
Nov 10 15:06:34 user nova-compute[75703]: </domain>
Nov 10 15:06:34 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2017438909',display_name='tempest-TestVolumeBootPattern-server-2017438909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2017438909',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-nnzzy5tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:06:05Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=da3f48e7-be1a-4a4a-89f9-343c394ad7d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG os_vif [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3867834-e559-5cbc-96e7-68a1a76ab2d0', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3b3285a-13, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3b3285a-13, col_values=(('qos', UUID('474fcd86-ce44-435d-b033-a0fc15a4c105')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3b3285a-13, col_values=(('external_ids', {'iface-id': 'd3b3285a-13fa-492d-9437-478271ca2e27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:fb:39', 'vm-uuid': 'da3f48e7-be1a-4a4a-89f9-343c394ad7d4'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: INFO os_vif [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13')
Nov 10 15:06:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:06:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No VIF found with MAC fa:16:3e:7f:fb:39, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-67711e9b-f6e2-4024-99de-1cfcc86c3d80 req-6100dfc0-8e24-4c7e-b087-48c0db4bc5ac service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-67711e9b-f6e2-4024-99de-1cfcc86c3d80 req-6100dfc0-8e24-4c7e-b087-48c0db4bc5ac service nova] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-67711e9b-f6e2-4024-99de-1cfcc86c3d80 req-6100dfc0-8e24-4c7e-b087-48c0db4bc5ac service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-67711e9b-f6e2-4024-99de-1cfcc86c3d80 req-6100dfc0-8e24-4c7e-b087-48c0db4bc5ac service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-67711e9b-f6e2-4024-99de-1cfcc86c3d80 req-6100dfc0-8e24-4c7e-b087-48c0db4bc5ac service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] No waiting events found dispatching network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:35 user nova-compute[75703]: WARNING nova.compute.manager [req-67711e9b-f6e2-4024-99de-1cfcc86c3d80 req-6100dfc0-8e24-4c7e-b087-48c0db4bc5ac service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received unexpected event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b for instance with vm_state building and task_state spawning.
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:06:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Instance spawned successfully.
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:35 user nova-compute[75703]: INFO nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 10 15:06:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:06:36 user nova-compute[75703]: INFO nova.compute.manager [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Took 7.39 seconds to build instance.
Nov 10 15:06:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-983de774-f187-46e6-89ec-4317b47f88ca tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.503s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-cd2e7db6-ff5a-4aa8-b763-bddfe6ee591b req-202bfdf9-f83d-4636-b4e3-d6e38b3686ec service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd2e7db6-ff5a-4aa8-b763-bddfe6ee591b req-202bfdf9-f83d-4636-b4e3-d6e38b3686ec service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd2e7db6-ff5a-4aa8-b763-bddfe6ee591b req-202bfdf9-f83d-4636-b4e3-d6e38b3686ec service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd2e7db6-ff5a-4aa8-b763-bddfe6ee591b req-202bfdf9-f83d-4636-b4e3-d6e38b3686ec service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-cd2e7db6-ff5a-4aa8-b763-bddfe6ee591b req-202bfdf9-f83d-4636-b4e3-d6e38b3686ec service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:36 user nova-compute[75703]: WARNING nova.compute.manager [req-cd2e7db6-ff5a-4aa8-b763-bddfe6ee591b req-202bfdf9-f83d-4636-b4e3-d6e38b3686ec service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received unexpected event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with vm_state building and task_state spawning.
Nov 10 15:06:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-583befe7-1335-4419-9833-b9a602e9f0d4 req-1bff9e64-6ad6-4d19-8988-64969f3bfc70 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-583befe7-1335-4419-9833-b9a602e9f0d4 req-1bff9e64-6ad6-4d19-8988-64969f3bfc70 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-583befe7-1335-4419-9833-b9a602e9f0d4 req-1bff9e64-6ad6-4d19-8988-64969f3bfc70 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-583befe7-1335-4419-9833-b9a602e9f0d4 req-1bff9e64-6ad6-4d19-8988-64969f3bfc70 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-583befe7-1335-4419-9833-b9a602e9f0d4 req-1bff9e64-6ad6-4d19-8988-64969f3bfc70 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:38 user nova-compute[75703]: WARNING nova.compute.manager [req-583befe7-1335-4419-9833-b9a602e9f0d4 req-1bff9e64-6ad6-4d19-8988-64969f3bfc70 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received unexpected event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with vm_state building and task_state spawning.
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:06:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Instance spawned successfully.
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:38 user nova-compute[75703]: INFO nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 10 15:06:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:06:38 user nova-compute[75703]: INFO nova.compute.manager [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Took 34.75 seconds to build instance.
Nov 10 15:06:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fd766573-a665-44f0-84a8-5e0c694ea53f tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.897s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:06:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:46 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:06:46 user nova-compute[75703]: INFO nova.compute.claims [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Claim successful on node user
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.network.neutron [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:06:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.policy [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23d189e700bd40ed8ee23d74de3a0681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9763add2a3741d1a75370ee532cc2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:06:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Creating image(s)
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "/opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "/opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "/opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.189s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk 1073741824" returned: 0 in 0.057s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:06:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Successfully created port: 4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Cannot resize image /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Ensure instance console log exists: /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Successfully updated port: 4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquired lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-changed-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.compute.manager [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Refreshing instance network info cache due to event network-changed-4056844c-0fcf-4a39-a6d1-c6327a9d640e. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] Acquiring lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:06:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Releasing lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Instance network_info: |[{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] Acquired lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.neutron [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Refreshing network info cache for port 4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Start _get_guest_xml network_info=[{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:06:49 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:49 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1224786784',display_name='tempest-TestStampPattern-server-1224786784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1224786784',id=42,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnBXfBlOXi2aS+QsQoo4WrpyvXZk+kDG3vQXqkaS4Sck7gWlnx2z2npznqQCZiwOuw3oc2sro6uqziSWJxc6dsLg3QQ16Ey8DOQXS+LIVfU5uH0OsAz1r4O0pGf39XV3w==',key_name='tempest-TestStampPattern-32336318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9763add2a3741d1a75370ee532cc2a3',ramdisk_id='',reservation_id='r-aaated74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606130469',owner_user_name='tempest-TestStampPattern-1606130469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:06:47Z,user_data=None,user_id='23d189e700bd40ed8ee23d74de3a0681',uuid=b84f952d-98ef-41c8-b2e1-313a5b553544,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converting VIF {"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.objects.instance [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'pci_devices' on Instance uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:06:49 user nova-compute[75703]:   <uuid>b84f952d-98ef-41c8-b2e1-313a5b553544</uuid>
Nov 10 15:06:49 user nova-compute[75703]:   <name>instance-0000002a</name>
Nov 10 15:06:49 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:06:49 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:06:49 user nova-compute[75703]:   <metadata>
Nov 10 15:06:49 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:06:49 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:06:49 user nova-compute[75703]:       <nova:name>tempest-TestStampPattern-server-1224786784</nova:name>
Nov 10 15:06:49 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:06:49</nova:creationTime>
Nov 10 15:06:49 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:06:49 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:06:49 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:06:49 user nova-compute[75703]:       <nova:owner>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:user uuid="23d189e700bd40ed8ee23d74de3a0681">tempest-TestStampPattern-1606130469-project-member</nova:user>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:project uuid="c9763add2a3741d1a75370ee532cc2a3">tempest-TestStampPattern-1606130469</nova:project>
Nov 10 15:06:49 user nova-compute[75703]:       </nova:owner>
Nov 10 15:06:49 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:06:49 user nova-compute[75703]:       <nova:ports>
Nov 10 15:06:49 user nova-compute[75703]:         <nova:port uuid="4056844c-0fcf-4a39-a6d1-c6327a9d640e">
Nov 10 15:06:49 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 15:06:49 user nova-compute[75703]:         </nova:port>
Nov 10 15:06:49 user nova-compute[75703]:       </nova:ports>
Nov 10 15:06:49 user nova-compute[75703]:     </nova:instance>
Nov 10 15:06:49 user nova-compute[75703]:   </metadata>
Nov 10 15:06:49 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:06:49 user nova-compute[75703]:     <system>
Nov 10 15:06:49 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:06:49 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:06:49 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:06:49 user nova-compute[75703]:       <entry name="serial">b84f952d-98ef-41c8-b2e1-313a5b553544</entry>
Nov 10 15:06:49 user nova-compute[75703]:       <entry name="uuid">b84f952d-98ef-41c8-b2e1-313a5b553544</entry>
Nov 10 15:06:49 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:06:49 user nova-compute[75703]:     </system>
Nov 10 15:06:49 user nova-compute[75703]:   </sysinfo>
Nov 10 15:06:49 user nova-compute[75703]:   <os>
Nov 10 15:06:49 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:06:49 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:06:49 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:06:49 user nova-compute[75703]:   </os>
Nov 10 15:06:49 user nova-compute[75703]:   <features>
Nov 10 15:06:49 user nova-compute[75703]:     <acpi/>
Nov 10 15:06:49 user nova-compute[75703]:     <apic/>
Nov 10 15:06:49 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:06:49 user nova-compute[75703]:   </features>
Nov 10 15:06:49 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:06:49 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:06:49 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:06:49 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:06:49 user nova-compute[75703]:   </clock>
Nov 10 15:06:49 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:06:49 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:06:49 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:06:49 user nova-compute[75703]:   </cpu>
Nov 10 15:06:49 user nova-compute[75703]:   <devices>
Nov 10 15:06:49 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:06:49 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:06:49 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk"/>
Nov 10 15:06:49 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:06:49 user nova-compute[75703]:     </disk>
Nov 10 15:06:49 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:06:49 user nova-compute[75703]:       <mac address="fa:16:3e:6b:35:93"/>
Nov 10 15:06:49 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:49 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:06:49 user nova-compute[75703]:       <target dev="tap4056844c-0f"/>
Nov 10 15:06:49 user nova-compute[75703]:     </interface>
Nov 10 15:06:49 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:06:49 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/console.log" append="off"/>
Nov 10 15:06:49 user nova-compute[75703]:     </serial>
Nov 10 15:06:49 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:06:49 user nova-compute[75703]:     <video>
Nov 10 15:06:49 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:06:49 user nova-compute[75703]:     </video>
Nov 10 15:06:49 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:06:49 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:06:49 user nova-compute[75703]:     </rng>
Nov 10 15:06:49 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:06:49 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:06:49 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:06:49 user nova-compute[75703]:     </memballoon>
Nov 10 15:06:49 user nova-compute[75703]:   </devices>
Nov 10 15:06:49 user nova-compute[75703]: </domain>
Nov 10 15:06:49 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1224786784',display_name='tempest-TestStampPattern-server-1224786784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1224786784',id=42,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnBXfBlOXi2aS+QsQoo4WrpyvXZk+kDG3vQXqkaS4Sck7gWlnx2z2npznqQCZiwOuw3oc2sro6uqziSWJxc6dsLg3QQ16Ey8DOQXS+LIVfU5uH0OsAz1r4O0pGf39XV3w==',key_name='tempest-TestStampPattern-32336318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9763add2a3741d1a75370ee532cc2a3',ramdisk_id='',reservation_id='r-aaated74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606130469',owner_user_name='tempest-TestStampPattern-1606130469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:06:47Z,user_data=None,user_id='23d189e700bd40ed8ee23d74de3a0681',uuid=b84f952d-98ef-41c8-b2e1-313a5b553544,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converting VIF {"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG os_vif [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e274b633-43a1-519d-b1f8-138a1c60b6d0', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4056844c-0f, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4056844c-0f, col_values=(('qos', UUID('ab3ba0dd-ce4e-4dce-b7a5-6cf61ee2d568')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4056844c-0f, col_values=(('external_ids', {'iface-id': '4056844c-0fcf-4a39-a6d1-c6327a9d640e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:35:93', 'vm-uuid': 'b84f952d-98ef-41c8-b2e1-313a5b553544'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:49 user nova-compute[75703]: INFO os_vif [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f')
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No VIF found with MAC fa:16:3e:6b:35:93, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.neutron [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updated VIF entry in instance network info cache for port 4056844c-0fcf-4a39-a6d1-c6327a9d640e. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG nova.network.neutron [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-967a140c-957b-4c30-bbad-1722655504c3 req-36f639f6-b79f-4337-8fde-8f2aecd6fa51 service nova] Releasing lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:06:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-f9860a7f-4f23-4d08-933f-5c3c8b8908ad req-c33cfcda-5346-43e7-b05c-13e37d0d201f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f9860a7f-4f23-4d08-933f-5c3c8b8908ad req-c33cfcda-5346-43e7-b05c-13e37d0d201f service nova] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f9860a7f-4f23-4d08-933f-5c3c8b8908ad req-c33cfcda-5346-43e7-b05c-13e37d0d201f service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f9860a7f-4f23-4d08-933f-5c3c8b8908ad req-c33cfcda-5346-43e7-b05c-13e37d0d201f service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG nova.compute.manager [req-f9860a7f-4f23-4d08-933f-5c3c8b8908ad req-c33cfcda-5346-43e7-b05c-13e37d0d201f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] No waiting events found dispatching network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:51 user nova-compute[75703]: WARNING nova.compute.manager [req-f9860a7f-4f23-4d08-933f-5c3c8b8908ad req-c33cfcda-5346-43e7-b05c-13e37d0d201f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received unexpected event network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e for instance with vm_state building and task_state spawning.
Nov 10 15:06:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:52 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:06:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:06:52 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Instance spawned successfully.
Nov 10 15:06:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:06:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-86c7c7a2-1700-46a3-a06e-9c2149303b12 req-afc43d28-d4dc-4493-9a5e-4a35f26823af service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-86c7c7a2-1700-46a3-a06e-9c2149303b12 req-afc43d28-d4dc-4493-9a5e-4a35f26823af service nova] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-86c7c7a2-1700-46a3-a06e-9c2149303b12 req-afc43d28-d4dc-4493-9a5e-4a35f26823af service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-86c7c7a2-1700-46a3-a06e-9c2149303b12 req-afc43d28-d4dc-4493-9a5e-4a35f26823af service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-86c7c7a2-1700-46a3-a06e-9c2149303b12 req-afc43d28-d4dc-4493-9a5e-4a35f26823af service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] No waiting events found dispatching network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:06:53 user nova-compute[75703]: WARNING nova.compute.manager [req-86c7c7a2-1700-46a3-a06e-9c2149303b12 req-afc43d28-d4dc-4493-9a5e-4a35f26823af service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received unexpected event network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e for instance with vm_state building and task_state spawning.
Nov 10 15:06:53 user nova-compute[75703]: INFO nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 10 15:06:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:06:53 user nova-compute[75703]: INFO nova.compute.manager [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Took 6.50 seconds to build instance.
Nov 10 15:06:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-812bb3df-4f5f-4bc2-b9e8-3d2ea935b95f tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.601s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:06:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:06:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:01 user nova-compute[75703]: INFO nova.compute.manager [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Terminating instance
Nov 10 15:07:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b0e3320-2545-4875-90dc-dd9debc72b88 req-0a3eb357-dac6-43b2-b236-d8c726aa03ca service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-vif-unplugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b0e3320-2545-4875-90dc-dd9debc72b88 req-0a3eb357-dac6-43b2-b236-d8c726aa03ca service nova] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b0e3320-2545-4875-90dc-dd9debc72b88 req-0a3eb357-dac6-43b2-b236-d8c726aa03ca service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b0e3320-2545-4875-90dc-dd9debc72b88 req-0a3eb357-dac6-43b2-b236-d8c726aa03ca service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b0e3320-2545-4875-90dc-dd9debc72b88 req-0a3eb357-dac6-43b2-b236-d8c726aa03ca service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] No waiting events found dispatching network-vif-unplugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b0e3320-2545-4875-90dc-dd9debc72b88 req-0a3eb357-dac6-43b2-b236-d8c726aa03ca service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-vif-unplugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:07:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Instance destroyed successfully.
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lazy-loading 'resources' on Instance uuid 642d3e1d-4973-4759-8396-0cf73dcfce41 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2016906769',display_name='tempest-ServerActionsTestOtherA-server-2016906769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2016906769',id=14,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAN+NwdXPOvBunVbyBXt6WRmHn6/qL/QYaOf7RntOE3KDDbgx2ItG3wVWCVkw7DFKc2zeo0nLqQzTDkZ/9dfH5kd4X3OfLL+IdHv3layJRwM8SNfUBw6MSVb1o8nWjUw==',key_name='tempest-keypair-175967266',keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37ddb2fd8ebd40b0bee398bd9969a0ee',ramdisk_id='',reservation_id='r-e4z8jmj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1989770067',owner_user_name='tempest-ServerActionsTestOtherA-1989770067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23ee54b16d604b829f2088d8e850c48c',uuid=642d3e1d-4973-4759-8396-0cf73dcfce41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converting VIF {"id": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "address": "fa:16:3e:9a:a6:46", "network": {"id": "a22ec7de-672e-4ce6-85e2-505666311224", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1407612440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37ddb2fd8ebd40b0bee398bd9969a0ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e5b42e-cf", "ovs_interfaceid": "11e5b42e-cf66-4a9e-88b7-818c7c13bee5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG os_vif [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11e5b42e-cf, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dd6e323-d8ba-4d6c-8b8e-828fe3e50a1d) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:02 user nova-compute[75703]: INFO os_vif [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:a6:46,bridge_name='br-int',has_traffic_filtering=True,id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5,network=Network(a22ec7de-672e-4ce6-85e2-505666311224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e5b42e-cf')
Nov 10 15:07:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Deleting instance files /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41_del
Nov 10 15:07:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Deletion of /opt/stack/data/nova/instances/642d3e1d-4973-4759-8396-0cf73dcfce41_del complete
Nov 10 15:07:02 user nova-compute[75703]: INFO nova.compute.manager [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 15:07:02 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:02 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Took 0.47 seconds to deallocate network for instance.
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-3c142de5-c628-4798-b3f9-50a9589c4ea6 req-8938ef5a-e297-40e0-b9fc-61e16981870f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-vif-deleted-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:02 user nova-compute[75703]: INFO nova.compute.manager [req-3c142de5-c628-4798-b3f9-50a9589c4ea6 req-8938ef5a-e297-40e0-b9fc-61e16981870f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Neutron deleted interface 11e5b42e-cf66-4a9e-88b7-818c7c13bee5; detaching it from the instance and deleting it from the info cache
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-3c142de5-c628-4798-b3f9-50a9589c4ea6 req-8938ef5a-e297-40e0-b9fc-61e16981870f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-3c142de5-c628-4798-b3f9-50a9589c4ea6 req-8938ef5a-e297-40e0-b9fc-61e16981870f service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Detach interface failed, port_id=11e5b42e-cf66-4a9e-88b7-818c7c13bee5, reason: Instance 642d3e1d-4973-4759-8396-0cf73dcfce41 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:03 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Deleted allocations for instance 642d3e1d-4973-4759-8396-0cf73dcfce41
Nov 10 15:07:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6309dfa7-cdb6-4846-8136-11974f60c975 tempest-ServerActionsTestOtherA-1989770067 tempest-ServerActionsTestOtherA-1989770067-project-member] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-58897b1e-c83b-4010-bc37-d836141404f6 req-ccb83f0e-89a2-4eb7-af5d-9c51e80f0fd9 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received event network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-58897b1e-c83b-4010-bc37-d836141404f6 req-ccb83f0e-89a2-4eb7-af5d-9c51e80f0fd9 service nova] Acquiring lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-58897b1e-c83b-4010-bc37-d836141404f6 req-ccb83f0e-89a2-4eb7-af5d-9c51e80f0fd9 service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-58897b1e-c83b-4010-bc37-d836141404f6 req-ccb83f0e-89a2-4eb7-af5d-9c51e80f0fd9 service nova] Lock "642d3e1d-4973-4759-8396-0cf73dcfce41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-58897b1e-c83b-4010-bc37-d836141404f6 req-ccb83f0e-89a2-4eb7-af5d-9c51e80f0fd9 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] No waiting events found dispatching network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:03 user nova-compute[75703]: WARNING nova.compute.manager [req-58897b1e-c83b-4010-bc37-d836141404f6 req-ccb83f0e-89a2-4eb7-af5d-9c51e80f0fd9 service nova] [instance: 642d3e1d-4973-4759-8396-0cf73dcfce41] Received unexpected event network-vif-plugged-11e5b42e-cf66-4a9e-88b7-818c7c13bee5 for instance with vm_state deleted and task_state None.
Nov 10 15:07:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:07:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:11 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:07:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:07:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:07:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=24.980472564697266GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 3c2c4c67-ae89-40fb-896e-adad9aab8847 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance da3f48e7-be1a-4a4a-89f9-343c394ad7d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:07:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [{"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-a7660cf1-f3ab-4ce6-990f-676f84317fd6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:07:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:38 user nova-compute[75703]: INFO nova.compute.manager [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Terminating instance
Nov 10 15:07:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-f47415ad-865a-4912-be38-7124bac9016b req-93582fa5-16fc-4bc2-9263-51d909341d45 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-unplugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f47415ad-865a-4912-be38-7124bac9016b req-93582fa5-16fc-4bc2-9263-51d909341d45 service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f47415ad-865a-4912-be38-7124bac9016b req-93582fa5-16fc-4bc2-9263-51d909341d45 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f47415ad-865a-4912-be38-7124bac9016b req-93582fa5-16fc-4bc2-9263-51d909341d45 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-f47415ad-865a-4912-be38-7124bac9016b req-93582fa5-16fc-4bc2-9263-51d909341d45 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-unplugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-f47415ad-865a-4912-be38-7124bac9016b req-93582fa5-16fc-4bc2-9263-51d909341d45 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-unplugged-f93fde13-7f17-4094-a51c-374930061948 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Instance destroyed successfully.
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'resources' on Instance uuid 570421c8-0cd6-48fa-b3ee-87e60ac9e8df {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1275294798',display_name='tempest-ServerRescueNegativeTestJSON-server-1275294798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1275294798',id=18,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-w7jqnks9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:52:26Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=570421c8-0cd6-48fa-b3ee-87e60ac9e8df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "f93fde13-7f17-4094-a51c-374930061948", "address": "fa:16:3e:07:fe:81", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fde13-7f", "ovs_interfaceid": "f93fde13-7f17-4094-a51c-374930061948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG os_vif [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93fde13-7f, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f889a29-73f6-43b9-8b2c-5e22d4a685f2) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:39 user nova-compute[75703]: INFO os_vif [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:fe:81,bridge_name='br-int',has_traffic_filtering=True,id=f93fde13-7f17-4094-a51c-374930061948,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fde13-7f')
Nov 10 15:07:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Deleting instance files /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df_del
Nov 10 15:07:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Deletion of /opt/stack/data/nova/instances/570421c8-0cd6-48fa-b3ee-87e60ac9e8df_del complete
Nov 10 15:07:39 user nova-compute[75703]: INFO nova.compute.manager [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 10 15:07:39 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:07:39 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:39 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Took 0.44 seconds to deallocate network for instance.
Nov 10 15:07:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:40 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:07:40 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:07:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:40 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Deleted allocations for instance 570421c8-0cd6-48fa-b3ee-87e60ac9e8df
Nov 10 15:07:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bf0c9faa-7c9b-4a05-b602-5f5c6eda9445 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.599s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] Acquiring lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] Lock "570421c8-0cd6-48fa-b3ee-87e60ac9e8df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] No waiting events found dispatching network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:41 user nova-compute[75703]: WARNING nova.compute.manager [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received unexpected event network-vif-plugged-f93fde13-7f17-4094-a51c-374930061948 for instance with vm_state deleted and task_state None.
Nov 10 15:07:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-d35f0e9d-1498-4325-b6c0-fc5c4300d917 req-82235693-a235-43c7-926e-f2948db670b3 service nova] [instance: 570421c8-0cd6-48fa-b3ee-87e60ac9e8df] Received event network-vif-deleted-f93fde13-7f17-4094-a51c-374930061948 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:49 user nova-compute[75703]: INFO nova.compute.manager [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Terminating instance
Nov 10 15:07:49 user nova-compute[75703]: DEBUG nova.compute.manager [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-ada08db2-de7a-405b-a77e-3695ffa0dc1a req-9c4cac5a-fd95-4fe9-883c-6b66de7fb28c service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-unplugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ada08db2-de7a-405b-a77e-3695ffa0dc1a req-9c4cac5a-fd95-4fe9-883c-6b66de7fb28c service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ada08db2-de7a-405b-a77e-3695ffa0dc1a req-9c4cac5a-fd95-4fe9-883c-6b66de7fb28c service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ada08db2-de7a-405b-a77e-3695ffa0dc1a req-9c4cac5a-fd95-4fe9-883c-6b66de7fb28c service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-ada08db2-de7a-405b-a77e-3695ffa0dc1a req-9c4cac5a-fd95-4fe9-883c-6b66de7fb28c service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-unplugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-ada08db2-de7a-405b-a77e-3695ffa0dc1a req-9c4cac5a-fd95-4fe9-883c-6b66de7fb28c service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-unplugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:07:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Instance destroyed successfully.
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.objects.instance [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lazy-loading 'resources' on Instance uuid 3c2c4c67-ae89-40fb-896e-adad9aab8847 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126003728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126003728',id=39,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdw1u2qoOd7q3vELLmwdLPfjgxtXAqZJa0eq8AihVHD2jH7gX1z4EECZ2x5dfAvFGXe9PpcGEYsA6x4DRFQpnMXLwbfBdquDFaLTfOUqjpjVKFk5Th2gBDaRt1tOCCoAA==',key_name='tempest-keypair-1081069009',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:06:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baf2404e273a4409ae3a1bb5d57eed08',ramdisk_id='',reservation_id='r-q6163v6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2134379644',owner_user_name='tempest-AttachVolumeShelveTestJSON-2134379644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37caa38086ae47a0be1d7f6f6a5aa6d6',uuid=3c2c4c67-ae89-40fb-896e-adad9aab8847,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converting VIF {"id": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "address": "fa:16:3e:83:87:55", "network": {"id": "bdc91925-5d9a-4ed8-9c11-bd8071097850", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-433510235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2404e273a4409ae3a1bb5d57eed08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2570295-7c", "ovs_interfaceid": "e2570295-7c57-4c22-b9da-911adf6fe0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG os_vif [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2570295-7c, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=772415f7-42d0-4c01-936e-9b4869124106) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:50 user nova-compute[75703]: INFO os_vif [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:87:55,bridge_name='br-int',has_traffic_filtering=True,id=e2570295-7c57-4c22-b9da-911adf6fe0b7,network=Network(bdc91925-5d9a-4ed8-9c11-bd8071097850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2570295-7c')
Nov 10 15:07:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Deleting instance files /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847_del
Nov 10 15:07:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Deletion of /opt/stack/data/nova/instances/3c2c4c67-ae89-40fb-896e-adad9aab8847_del complete
Nov 10 15:07:50 user nova-compute[75703]: INFO nova.compute.manager [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 10 15:07:50 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:07:50 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:07:51 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:51 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Took 0.75 seconds to deallocate network for instance.
Nov 10 15:07:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:51 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:07:51 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:07:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:51 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Deleted allocations for instance 3c2c4c67-ae89-40fb-896e-adad9aab8847
Nov 10 15:07:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-84973d0d-1063-416e-8f15-2bd40759e3aa tempest-AttachVolumeShelveTestJSON-2134379644 tempest-AttachVolumeShelveTestJSON-2134379644-project-member] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] Acquiring lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] Lock "3c2c4c67-ae89-40fb-896e-adad9aab8847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] No waiting events found dispatching network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:52 user nova-compute[75703]: WARNING nova.compute.manager [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received unexpected event network-vif-plugged-e2570295-7c57-4c22-b9da-911adf6fe0b7 for instance with vm_state deleted and task_state None.
Nov 10 15:07:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-5f759430-333d-4e12-8e90-ceb2a0331eb0 req-b8caafd0-349a-4e15-975c-3a70d0956b60 service nova] [instance: 3c2c4c67-ae89-40fb-896e-adad9aab8847] Received event network-vif-deleted-e2570295-7c57-4c22-b9da-911adf6fe0b7 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-changed-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Refreshing instance network info cache due to event network-changed-d3b3285a-13fa-492d-9437-478271ca2e27. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] Acquiring lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] Acquired lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:07:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Refreshing network info cache for port d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updated VIF entry in instance network info cache for port d3b3285a-13fa-492d-9437-478271ca2e27. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.network.neutron [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updating instance_info_cache with network_info: [{"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-bf146aa1-bb41-4ae8-a771-509091e5bbd7 req-37e932be-f12f-46d1-93fa-58e54cec1c77 service nova] Releasing lock "refresh_cache-da3f48e7-be1a-4a4a-89f9-343c394ad7d4" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:56 user nova-compute[75703]: INFO nova.compute.manager [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Terminating instance
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.compute.manager [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Instance destroyed successfully.
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.objects.instance [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'resources' on Instance uuid da3f48e7-be1a-4a4a-89f9-343c394ad7d4 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2017438909',display_name='tempest-TestVolumeBootPattern-server-2017438909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2017438909',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-nnzzy5tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:06:39Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=da3f48e7-be1a-4a4a-89f9-343c394ad7d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "d3b3285a-13fa-492d-9437-478271ca2e27", "address": "fa:16:3e:7f:fb:39", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b3285a-13", "ovs_interfaceid": "d3b3285a-13fa-492d-9437-478271ca2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG os_vif [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3b3285a-13, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=474fcd86-ce44-435d-b033-a0fc15a4c105) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:56 user nova-compute[75703]: INFO os_vif [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:39,bridge_name='br-int',has_traffic_filtering=True,id=d3b3285a-13fa-492d-9437-478271ca2e27,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b3285a-13')
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:07:57 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9e7a05-a264-4590-92f9-8baeac76bbac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:07:57 user nova-compute[75703]: No targets found.
Nov 10 15:07:57 user nova-compute[75703]: iSNS:
Nov 10 15:07:57 user nova-compute[75703]: No targets found.
Nov 10 15:07:57 user nova-compute[75703]: STATIC:
Nov 10 15:07:57 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7
Nov 10 15:07:57 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:07:57 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:07:57 user nova-compute[75703]: FIRMWARE:
Nov 10 15:07:57 user nova-compute[75703]: No targets found.
Nov 10 15:07:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:07:57 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:07:57 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dced67-e9f5-482d-ac4f-9fed1c0bde52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d236d3-e522-46be-ba76-2f0866df552b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:07:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:07:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fa0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ef2a7-a2d0-452e-bd1a-7e1529cec4db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d8a62-22d3-4064-8d72-0e1534abcf35]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3e494b-2624-4de0-8c3c-66baaf246e37]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fba2d7b-8f97-4619-a103-45b917a3b53a]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO309e642b-8ab8dd30b0e8a4a4', '/dev/disk/by-id/scsi-23861623864643330', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_309e642b') {{(pid=87268) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca988ca7-e887-431b-9f91-f48227bc6511]: (4, None) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[15820603-355d-4422-aef7-48dfad48d5fa]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8f70c3-b8a7-4328-a5b9-ae13d83861a3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]
Nov 10 15:07:57 user nova-compute[75703]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.
Nov 10 15:07:57 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e130f-bc27-4334-9654-ca16b3ad69cd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== disconnect_volume: return (380ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:07:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Deleting instance files /opt/stack/data/nova/instances/da3f48e7-be1a-4a4a-89f9-343c394ad7d4_del
Nov 10 15:07:57 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Deletion of /opt/stack/data/nova/instances/da3f48e7-be1a-4a4a-89f9-343c394ad7d4_del complete
Nov 10 15:07:57 user nova-compute[75703]: INFO nova.compute.manager [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-unplugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-unplugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-unplugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:57 user nova-compute[75703]: WARNING nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received unexpected event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with vm_state active and task_state deleting.
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:57 user nova-compute[75703]: WARNING nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received unexpected event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with vm_state active and task_state deleting.
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:57 user nova-compute[75703]: WARNING nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received unexpected event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with vm_state active and task_state deleting.
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-unplugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-unplugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-561ab19e-c294-4a26-bf95-b3aa54f14cb5 req-5eecd76f-1803-41db-81b0-b4088ee8e973 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-unplugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:07:58 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:58 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Took 0.74 seconds to deallocate network for instance.
Nov 10 15:07:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-1a0a268a-b202-4f47-a0aa-9dcc34b59474 req-15886e37-9a66-4848-9f58-4b2e3a42c652 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-deleted-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:58 user nova-compute[75703]: INFO nova.compute.manager [req-1a0a268a-b202-4f47-a0aa-9dcc34b59474 req-15886e37-9a66-4848-9f58-4b2e3a42c652 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Neutron deleted interface d3b3285a-13fa-492d-9437-478271ca2e27; detaching it from the instance and deleting it from the info cache
Nov 10 15:07:58 user nova-compute[75703]: DEBUG nova.network.neutron [req-1a0a268a-b202-4f47-a0aa-9dcc34b59474 req-15886e37-9a66-4848-9f58-4b2e3a42c652 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:07:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-1a0a268a-b202-4f47-a0aa-9dcc34b59474 req-15886e37-9a66-4848-9f58-4b2e3a42c652 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Detach interface failed, port_id=d3b3285a-13fa-492d-9437-478271ca2e27, reason: Instance da3f48e7-be1a-4a4a-89f9-343c394ad7d4 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:07:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-23ddb280-5252-49eb-bd7a-539671917d43 req-6d24e876-e408-4aed-a0dd-f8b18ee6f961 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:07:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23ddb280-5252-49eb-bd7a-539671917d43 req-6d24e876-e408-4aed-a0dd-f8b18ee6f961 service nova] Acquiring lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:07:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23ddb280-5252-49eb-bd7a-539671917d43 req-6d24e876-e408-4aed-a0dd-f8b18ee6f961 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:07:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23ddb280-5252-49eb-bd7a-539671917d43 req-6d24e876-e408-4aed-a0dd-f8b18ee6f961 service nova] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:07:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-23ddb280-5252-49eb-bd7a-539671917d43 req-6d24e876-e408-4aed-a0dd-f8b18ee6f961 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] No waiting events found dispatching network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:07:59 user nova-compute[75703]: WARNING nova.compute.manager [req-23ddb280-5252-49eb-bd7a-539671917d43 req-6d24e876-e408-4aed-a0dd-f8b18ee6f961 service nova] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Received unexpected event network-vif-plugged-d3b3285a-13fa-492d-9437-478271ca2e27 for instance with vm_state active and task_state deleting.
Nov 10 15:07:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:01 user nova-compute[75703]: INFO nova.compute.manager [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: da3f48e7-be1a-4a4a-89f9-343c394ad7d4] Took 3.68 seconds to detach 1 volumes for instance.
Nov 10 15:08:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:02 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:08:02 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:08:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:02 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Deleted allocations for instance da3f48e7-be1a-4a4a-89f9-343c394ad7d4
Nov 10 15:08:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-ee88e1ab-5507-426f-ae2c-54f1a9d69555 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "da3f48e7-be1a-4a4a-89f9-343c394ad7d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.088s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:05 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:05 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:08:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:08:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:08:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:08:14 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8360MB free_disk=25.024452209472656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance a7660cf1-f3ab-4ce6-990f-676f84317fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:08:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:08:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:08:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:08:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Updating instance_info_cache with network_info: [{"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:08:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:08:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:08:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 4 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:08:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Deletion of /opt/stack/data/nova/instances/d4465989-c669-4edd-b7d2-f71e203b7142_resize failed
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:29 user nova-compute[75703]: INFO nova.compute.manager [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Terminating instance
Nov 10 15:08:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-4753dc49-2c0e-4ce6-97bc-68051885d5ef req-582e9062-3f99-47a3-8a8b-0bd3487b9459 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4753dc49-2c0e-4ce6-97bc-68051885d5ef req-582e9062-3f99-47a3-8a8b-0bd3487b9459 service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4753dc49-2c0e-4ce6-97bc-68051885d5ef req-582e9062-3f99-47a3-8a8b-0bd3487b9459 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4753dc49-2c0e-4ce6-97bc-68051885d5ef req-582e9062-3f99-47a3-8a8b-0bd3487b9459 service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-4753dc49-2c0e-4ce6-97bc-68051885d5ef req-582e9062-3f99-47a3-8a8b-0bd3487b9459 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:29 user nova-compute[75703]: DEBUG nova.compute.manager [req-4753dc49-2c0e-4ce6-97bc-68051885d5ef req-582e9062-3f99-47a3-8a8b-0bd3487b9459 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Instance destroyed successfully.
Nov 10 15:08:30 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lazy-loading 'resources' on Instance uuid a7660cf1-f3ab-4ce6-990f-676f84317fd6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T14:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1179544045',display_name='tempest-ServerRescueNegativeTestJSON-server-1179544045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1179544045',id=17,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T14:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5703fd918f4547218ac7ef97d6b1bbdc',ramdisk_id='',reservation_id='r-qo37v7vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926780524',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926780524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T14:57:23Z,user_data=None,user_id='6b7b8488f5964719b7b47ac4416c59ea',uuid=a7660cf1-f3ab-4ce6-990f-676f84317fd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converting VIF {"id": "887034ca-08fe-490d-9562-7ab8c57a8f21", "address": "fa:16:3e:e0:e4:6b", "network": {"id": "1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1612230215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5703fd918f4547218ac7ef97d6b1bbdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap887034ca-08", "ovs_interfaceid": "887034ca-08fe-490d-9562-7ab8c57a8f21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG os_vif [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap887034ca-08, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9409487a-0607-4244-956c-06500e55ef93) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:08:30 user nova-compute[75703]: INFO os_vif [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:6b,bridge_name='br-int',has_traffic_filtering=True,id=887034ca-08fe-490d-9562-7ab8c57a8f21,network=Network(1cf61c5d-5cc1-455b-9ca7-ccb090b5be0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap887034ca-08')
Nov 10 15:08:30 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Deleting instance files /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6_del
Nov 10 15:08:30 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Deletion of /opt/stack/data/nova/instances/a7660cf1-f3ab-4ce6-990f-676f84317fd6_del complete
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: INFO nova.compute.manager [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 10 15:08:30 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:08:31 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Took 0.77 seconds to deallocate network for instance.
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-e936fef0-d20a-4330-8022-db8d10faf85a req-93487478-23ac-43f6-9bee-703a833a5d57 service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-deleted-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:31 user nova-compute[75703]: WARNING nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state deleted and task_state None.
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:31 user nova-compute[75703]: WARNING nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state deleted and task_state None.
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:31 user nova-compute[75703]: WARNING nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state deleted and task_state None.
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:31 user nova-compute[75703]: WARNING nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-unplugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state deleted and task_state None.
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Acquiring lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] No waiting events found dispatching network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:31 user nova-compute[75703]: WARNING nova.compute.manager [req-a1eddae5-a8bf-4acd-8051-031a62dc8251 req-b83f63f9-a45e-4d1b-9861-0604bedcdfff service nova] [instance: a7660cf1-f3ab-4ce6-990f-676f84317fd6] Received unexpected event network-vif-plugged-887034ca-08fe-490d-9562-7ab8c57a8f21 for instance with vm_state deleted and task_state None.
Nov 10 15:08:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.675s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:31 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Deleted allocations for instance a7660cf1-f3ab-4ce6-990f-676f84317fd6
Nov 10 15:08:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f532f10f-5826-49ac-a8c0-1bea4e8923b5 tempest-ServerRescueNegativeTestJSON-1926780524 tempest-ServerRescueNegativeTestJSON-1926780524-project-member] Lock "a7660cf1-f3ab-4ce6-990f-676f84317fd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.646s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:37 user nova-compute[75703]: INFO nova.compute.manager [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Terminating instance
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-3555013f-a744-4636-9848-047186b5edb4 req-17620df9-f07c-45d2-90de-0524746dd688 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-unplugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3555013f-a744-4636-9848-047186b5edb4 req-17620df9-f07c-45d2-90de-0524746dd688 service nova] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3555013f-a744-4636-9848-047186b5edb4 req-17620df9-f07c-45d2-90de-0524746dd688 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3555013f-a744-4636-9848-047186b5edb4 req-17620df9-f07c-45d2-90de-0524746dd688 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-3555013f-a744-4636-9848-047186b5edb4 req-17620df9-f07c-45d2-90de-0524746dd688 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] No waiting events found dispatching network-vif-unplugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.compute.manager [req-3555013f-a744-4636-9848-047186b5edb4 req-17620df9-f07c-45d2-90de-0524746dd688 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-unplugged-a38f91e0-0b90-458b-b353-1372ab98662b for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Instance destroyed successfully.
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lazy-loading 'resources' on Instance uuid 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-215386609',display_name='tempest-VolumesActionsTest-instance-215386609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-215386609',id=41,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:06:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fe4c168e5b4444cad4c108505dfe149',ramdisk_id='',reservation_id='r-ys0no5my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-292125102',owner_user_name='tempest-VolumesActionsTest-292125102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:06:36Z,user_data=None,user_id='13372a749c2c414592ead6ec55b1d600',uuid=70b2c4ac-9aa6-459a-90b4-3c743e2efa4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Converting VIF {"id": "a38f91e0-0b90-458b-b353-1372ab98662b", "address": "fa:16:3e:86:af:c4", "network": {"id": "6014edd8-dfc7-4cc9-a31e-8c46af30fb2f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-12074285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fe4c168e5b4444cad4c108505dfe149", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38f91e0-0b", "ovs_interfaceid": "a38f91e0-0b90-458b-b353-1372ab98662b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG os_vif [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa38f91e0-0b, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f30b28f-745d-4ce9-924a-40d2b262c5d9) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:08:37 user nova-compute[75703]: INFO os_vif [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:af:c4,bridge_name='br-int',has_traffic_filtering=True,id=a38f91e0-0b90-458b-b353-1372ab98662b,network=Network(6014edd8-dfc7-4cc9-a31e-8c46af30fb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38f91e0-0b')
Nov 10 15:08:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Deleting instance files /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b_del
Nov 10 15:08:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Deletion of /opt/stack/data/nova/instances/70b2c4ac-9aa6-459a-90b4-3c743e2efa4b_del complete
Nov 10 15:08:37 user nova-compute[75703]: INFO nova.compute.manager [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 10 15:08:37 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:08:37 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-changed-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG nova.compute.manager [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Refreshing instance network info cache due to event network-changed-4056844c-0fcf-4a39-a6d1-c6327a9d640e. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] Acquiring lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] Acquired lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Refreshing network info cache for port 4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:08:38 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Took 0.86 seconds to deallocate network for instance.
Nov 10 15:08:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:08:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:39 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Deleted allocations for instance 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updated VIF entry in instance network info cache for port 4056844c-0fcf-4a39-a6d1-c6327a9d640e. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-fb61bc4f-0244-456f-b8dc-cf2492e63ce6 req-e93d008f-77bb-43a8-9187-597e45056c3f service nova] Releasing lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-63a7b195-4b2c-47d3-9d6d-ad2d8fb177e7 tempest-VolumesActionsTest-292125102 tempest-VolumesActionsTest-292125102-project-member] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'flavor' on Instance uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:39 user nova-compute[75703]: INFO nova.compute.manager [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Attaching volume b0ce5c7f-3b2e-4354-919a-d937e0c85550 to /dev/vdb
Nov 10 15:08:39 user nova-compute[75703]: DEBUG os_brick.utils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] No waiting events found dispatching network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:39 user nova-compute[75703]: WARNING nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received unexpected event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b for instance with vm_state deleted and task_state None.
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] No waiting events found dispatching network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:39 user nova-compute[75703]: WARNING nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received unexpected event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b for instance with vm_state deleted and task_state None.
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Acquiring lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] Lock "70b2c4ac-9aa6-459a-90b4-3c743e2efa4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] No waiting events found dispatching network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:08:39 user nova-compute[75703]: WARNING nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received unexpected event network-vif-plugged-a38f91e0-0b90-458b-b353-1372ab98662b for instance with vm_state deleted and task_state None.
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-795cf2f3-af19-4be9-ad64-6a307b3e2e09 req-99c9632c-77f9-4ec5-9a96-fd3117dbb6e5 service nova] [instance: 70b2c4ac-9aa6-459a-90b4-3c743e2efa4b] Received event network-vif-deleted-a38f91e0-0b90-458b-b353-1372ab98662b {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd3c82-f7b2-461d-92e0-f01f8c244a1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f0e80-c5c2-4313-9084-c3eddef9e555]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f789139-651c-4275-9b67-e05814ddd2e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b813cc0b-a7a8-41b0-850b-3582b990fffc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:08:39 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:08:39 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9bb29-3d9c-43f4-a1b4-e02b95a8dbfc]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG os_brick.utils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating existing volume attachment record: 7a938505-7a62-44f3-bc56-2fb366c1d722 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:08:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:08:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:08:47 user nova-compute[75703]: INFO nova.compute.claims [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Claim successful on node user
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:08:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.policy [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67a5a4845f164d8cba0951d82f2430e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c013cf84f8b414ba6d2d888ddc2ee1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:08:48 user nova-compute[75703]: INFO nova.virt.block_device [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Booting with volume b0779f06-151c-4e63-8364-417c1d24fbf7 at /dev/vda
Nov 10 15:08:48 user nova-compute[75703]: DEBUG os_brick.utils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ccb48b-0c9e-4ae5-a1d0-326512d2800f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[066227f6-5698-43f7-9ebd-09e0fbae0eb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8d5e7-f6bb-40b6-817e-547f2032b2fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5e07d2-8da2-4e63-a245-b736be34cea0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:08:48 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:08:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0cffb2-ea84-412d-9b8d-8984f0e9b39b]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG os_brick.utils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:08:48 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating existing volume attachment record: f301420c-c820-47f1-b3d7-611cee526756 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Successfully created port: fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Successfully updated port: fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquired lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-changed-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Refreshing instance network info cache due to event network-changed-fa4231eb-75f4-4b08-81c4-58e77b263859. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] Acquiring lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating instance_info_cache with network_info: [{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Releasing lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Instance network_info: |[{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] Acquired lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Refreshing network info cache for port fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updated VIF entry in instance network info cache for port fa4231eb-75f4-4b08-81c4-58e77b263859. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating instance_info_cache with network_info: [{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:08:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-08126d1e-7ec2-4c89-ad88-b94dd327aad5 req-9d6b243a-acd2-4726-ad78-975320b0df15 service nova] Releasing lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:08:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:08:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:08:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:09:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:09:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:09:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:06 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:09:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=25.076526641845703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b161728d-6d17-43a4-9663-37d7727f3b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:09:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:09:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoDQyCIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:09:28 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:09:28 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:09:28 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea9c26f-69e6-4108-9d74-90fe0857a4b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:09:28 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[194413e1-76ad-4924-9527-07534a707222]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550] added
Nov 10 15:09:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ce937-3080-4163-a6dc-275504000527]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[323a95d1-8acc-4255-a7ea-f9c633987b17]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoDQyCIV {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoDQyCIV" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8552c31b-ee5d-4e8f-88e3-74ca1db943e7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aoDQyCIV'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091a6cf-00b8-49f8-8937-960c17e1c1b5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4adc3ca-ecc7-439e-979a-6947a2385777]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:09:28 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:09:28 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:09:28 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:09:28 user nova-compute[75703]: 
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad433b53-31f4-451b-b4c4-8c95c19dabf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260]
Nov 10 15:09:28 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260] successful.
Nov 10 15:09:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a6bdf-29c1-4105-9ead-c4c47e4d0225]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477cb5f-c600-4d1c-8ab6-e5699977d563]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[515c2460-d140-4187-8653-a475f4888ca0]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoDQyCIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:09:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Creating image(s)
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Ensure instance console log exists: /opt/stack/data/nova/instances/b161728d-6d17-43a4-9663-37d7727f3b6b/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Start _get_guest_xml network_info=[{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'f301420c-c820-47f1-b3d7-611cee526756', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b161728d-6d17-43a4-9663-37d7727f3b6b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0779f06-151c-4e63-8364-417c1d24fbf7', 'serial': 'b0779f06-151c-4e63-8364-417c1d24fbf7'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:09:28 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:28 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:09:28 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:09:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26536393533636633', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393533636633', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.734s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:09:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:09:29 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'flavor' on Instance uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59610e0-7cff-4741-be5f-e15266c6fc7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:09:29 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:09:29 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:09:29 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:09:29 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:09:29 user nova-compute[75703]:   <serial>b0ce5c7f-3b2e-4354-919a-d937e0c85550</serial>
Nov 10 15:09:29 user nova-compute[75703]: </disk>
Nov 10 15:09:29 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[84715702-4623-43ae-adfa-eae2cdb9c476]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7] added
Nov 10 15:09:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b886ca3-5270-435c-ba41-1d31b42b6036]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c47fc1a-22a0-41ad-8f07-bcd2abf00999]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJGsQLlF {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJGsQLlF" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb494d-05ba-4dec-9ac2-3b23ac6df658]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aJGsQLlF'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9bb86-b5e7-435a-9d93-3d021cc7415c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf1e65-b659-4d99-8780-3c2a3d07181a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560bfb2-de5d-4913-97c9-cdbd8e80cb42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]
Nov 10 15:09:29 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.
Nov 10 15:09:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e990145-9964-47c8-bdbe-dea84912bd1d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86c7fe-aa12-4f6c-96c6-76805c9f7167]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:29 user nova-compute[75703]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:09:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:29 user nova-compute[75703]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:09:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b890e0-409c-419b-a50c-71f0061aa9e5]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No VIF found with MAC fa:16:3e:6b:35:93, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-f032bc7e-9edd-4928-87f1-965f38cb2f3b tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.864s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== connect_volume: return (2114ms) {'type': 'block', 'scsi_wwn': '23861623864643330', 'path': '/dev/sdc'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:09:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861623864643330', 'path': '/dev/sdc'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1844074232',display_name='tempest-TestVolumeBootPattern-server-1844074232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1844074232',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-ag4y96zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:08:48Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=b161728d-6d17-43a4-9663-37d7727f3b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'pci_devices' on Instance uuid b161728d-6d17-43a4-9663-37d7727f3b6b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:09:31 user nova-compute[75703]:   <uuid>b161728d-6d17-43a4-9663-37d7727f3b6b</uuid>
Nov 10 15:09:31 user nova-compute[75703]:   <name>instance-0000002b</name>
Nov 10 15:09:31 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:09:31 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:09:31 user nova-compute[75703]:   <metadata>
Nov 10 15:09:31 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:09:31 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:09:31 user nova-compute[75703]:       <nova:name>tempest-TestVolumeBootPattern-server-1844074232</nova:name>
Nov 10 15:09:31 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:09:28</nova:creationTime>
Nov 10 15:09:31 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:09:31 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:09:31 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:09:31 user nova-compute[75703]:       <nova:owner>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:user uuid="67a5a4845f164d8cba0951d82f2430e9">tempest-TestVolumeBootPattern-982390102-project-member</nova:user>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:project uuid="3c013cf84f8b414ba6d2d888ddc2ee1b">tempest-TestVolumeBootPattern-982390102</nova:project>
Nov 10 15:09:31 user nova-compute[75703]:       </nova:owner>
Nov 10 15:09:31 user nova-compute[75703]:       <nova:ports>
Nov 10 15:09:31 user nova-compute[75703]:         <nova:port uuid="fa4231eb-75f4-4b08-81c4-58e77b263859">
Nov 10 15:09:31 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 15:09:31 user nova-compute[75703]:         </nova:port>
Nov 10 15:09:31 user nova-compute[75703]:       </nova:ports>
Nov 10 15:09:31 user nova-compute[75703]:     </nova:instance>
Nov 10 15:09:31 user nova-compute[75703]:   </metadata>
Nov 10 15:09:31 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:09:31 user nova-compute[75703]:     <system>
Nov 10 15:09:31 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:09:31 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:09:31 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:09:31 user nova-compute[75703]:       <entry name="serial">b161728d-6d17-43a4-9663-37d7727f3b6b</entry>
Nov 10 15:09:31 user nova-compute[75703]:       <entry name="uuid">b161728d-6d17-43a4-9663-37d7727f3b6b</entry>
Nov 10 15:09:31 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:09:31 user nova-compute[75703]:     </system>
Nov 10 15:09:31 user nova-compute[75703]:   </sysinfo>
Nov 10 15:09:31 user nova-compute[75703]:   <os>
Nov 10 15:09:31 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:09:31 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:09:31 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:09:31 user nova-compute[75703]:   </os>
Nov 10 15:09:31 user nova-compute[75703]:   <features>
Nov 10 15:09:31 user nova-compute[75703]:     <acpi/>
Nov 10 15:09:31 user nova-compute[75703]:     <apic/>
Nov 10 15:09:31 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:09:31 user nova-compute[75703]:   </features>
Nov 10 15:09:31 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:09:31 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:09:31 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:09:31 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:09:31 user nova-compute[75703]:   </clock>
Nov 10 15:09:31 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:09:31 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:09:31 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:09:31 user nova-compute[75703]:   </cpu>
Nov 10 15:09:31 user nova-compute[75703]:   <devices>
Nov 10 15:09:31 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 15:09:31 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:09:31 user nova-compute[75703]:       <source dev="/dev/sdc"/>
Nov 10 15:09:31 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:09:31 user nova-compute[75703]:       <serial>b0779f06-151c-4e63-8364-417c1d24fbf7</serial>
Nov 10 15:09:31 user nova-compute[75703]:     </disk>
Nov 10 15:09:31 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:09:31 user nova-compute[75703]:       <mac address="fa:16:3e:81:75:b5"/>
Nov 10 15:09:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:09:31 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:09:31 user nova-compute[75703]:       <target dev="tapfa4231eb-75"/>
Nov 10 15:09:31 user nova-compute[75703]:     </interface>
Nov 10 15:09:31 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:09:31 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/b161728d-6d17-43a4-9663-37d7727f3b6b/console.log" append="off"/>
Nov 10 15:09:31 user nova-compute[75703]:     </serial>
Nov 10 15:09:31 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:09:31 user nova-compute[75703]:     <video>
Nov 10 15:09:31 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:09:31 user nova-compute[75703]:     </video>
Nov 10 15:09:31 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:09:31 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:09:31 user nova-compute[75703]:     </rng>
Nov 10 15:09:31 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:09:31 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:09:31 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:09:31 user nova-compute[75703]:     </memballoon>
Nov 10 15:09:31 user nova-compute[75703]:   </devices>
Nov 10 15:09:31 user nova-compute[75703]: </domain>
Nov 10 15:09:31 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1844074232',display_name='tempest-TestVolumeBootPattern-server-1844074232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1844074232',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-ag4y96zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:08:48Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=b161728d-6d17-43a4-9663-37d7727f3b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG os_vif [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72cdd43c-6c81-5521-890e-8ddc85895a13', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4231eb-75, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4231eb-75, col_values=(('qos', UUID('79187dcf-f550-45ac-9a15-bc15d155cb47')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4231eb-75, col_values=(('external_ids', {'iface-id': 'fa4231eb-75f4-4b08-81c4-58e77b263859', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:75:b5', 'vm-uuid': 'b161728d-6d17-43a4-9663-37d7727f3b6b'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:31 user nova-compute[75703]: INFO os_vif [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75')
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:09:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No VIF found with MAC fa:16:3e:81:75:b5, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-a7346989-eb5a-425f-b515-4bfa1d0e0bd8 req-04fa9b68-8716-4ddd-bf9e-9811fd171fb6 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a7346989-eb5a-425f-b515-4bfa1d0e0bd8 req-04fa9b68-8716-4ddd-bf9e-9811fd171fb6 service nova] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a7346989-eb5a-425f-b515-4bfa1d0e0bd8 req-04fa9b68-8716-4ddd-bf9e-9811fd171fb6 service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a7346989-eb5a-425f-b515-4bfa1d0e0bd8 req-04fa9b68-8716-4ddd-bf9e-9811fd171fb6 service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-a7346989-eb5a-425f-b515-4bfa1d0e0bd8 req-04fa9b68-8716-4ddd-bf9e-9811fd171fb6 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] No waiting events found dispatching network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:09:32 user nova-compute[75703]: WARNING nova.compute.manager [req-a7346989-eb5a-425f-b515-4bfa1d0e0bd8 req-04fa9b68-8716-4ddd-bf9e-9811fd171fb6 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received unexpected event network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 for instance with vm_state building and task_state spawning.
Nov 10 15:09:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:33 user nova-compute[75703]: INFO nova.compute.manager [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Detaching volume b0ce5c7f-3b2e-4354-919a-d937e0c85550
Nov 10 15:09:33 user nova-compute[75703]: INFO nova.virt.block_device [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Attempting to driver detach volume b0ce5c7f-3b2e-4354-919a-d937e0c85550 from mountpoint /dev/vdb
Nov 10 15:09:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Attempting to detach device vdb from instance b84f952d-98ef-41c8-b2e1-313a5b553544 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:09:33 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:09:33 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:09:33 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:09:33 user nova-compute[75703]:   <serial>b0ce5c7f-3b2e-4354-919a-d937e0c85550</serial>
Nov 10 15:09:33 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:09:33 user nova-compute[75703]: </disk>
Nov 10 15:09:33 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:09:33 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully detached device vdb from instance b84f952d-98ef-41c8-b2e1-313a5b553544 from the persistent domain config.
Nov 10 15:09:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b84f952d-98ef-41c8-b2e1-313a5b553544 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:09:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:09:33 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:09:33 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:09:33 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:09:33 user nova-compute[75703]:   <serial>b0ce5c7f-3b2e-4354-919a-d937e0c85550</serial>
Nov 10 15:09:33 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:09:33 user nova-compute[75703]: </disk>
Nov 10 15:09:33 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:09:34 user nova-compute[75703]: INFO nova.compute.claims [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Claim successful on node user
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:09:34 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG nova.policy [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d775cbe0387444bb85fcef28385a65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057af934a5324de19a6c05e2a0379f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:09:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:09:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Instance spawned successfully.
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:09:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Creating image(s)
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "/opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "/opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-680cf06a-ebcc-41d1-8c67-72490068fbea req-9d1f693a-876d-494f-ad98-4550b6bf895c service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-680cf06a-ebcc-41d1-8c67-72490068fbea req-9d1f693a-876d-494f-ad98-4550b6bf895c service nova] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-680cf06a-ebcc-41d1-8c67-72490068fbea req-9d1f693a-876d-494f-ad98-4550b6bf895c service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-680cf06a-ebcc-41d1-8c67-72490068fbea req-9d1f693a-876d-494f-ad98-4550b6bf895c service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.compute.manager [req-680cf06a-ebcc-41d1-8c67-72490068fbea req-9d1f693a-876d-494f-ad98-4550b6bf895c service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] No waiting events found dispatching network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:09:35 user nova-compute[75703]: WARNING nova.compute.manager [req-680cf06a-ebcc-41d1-8c67-72490068fbea req-9d1f693a-876d-494f-ad98-4550b6bf895c service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received unexpected event network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 for instance with vm_state building and task_state spawning.
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:35 user nova-compute[75703]: INFO nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.259s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:35 user nova-compute[75703]: INFO nova.compute.manager [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Took 47.54 seconds to build instance.
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-64ede973-5446-45e4-b062-6601ed0b382d tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.650s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk 1073741824" returned: 0 in 0.058s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.213s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Successfully created port: b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Cannot resize image /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Ensure instance console log exists: /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Successfully updated port: b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-changed-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Refreshing instance network info cache due to event network-changed-b7c0f108-248d-4cc7-8f98-310482a30009. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:09:36 user nova-compute[75703]: INFO nova.compute.claims [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Claim successful on node user
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:09:36 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Instance network_info: |[{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Refreshing network info cache for port b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Start _get_guest_xml network_info=[{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:09:37 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:37 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1081710307',display_name='tempest-SnapshotDataIntegrityTests-server-1081710307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1081710307',id=44,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlKmybVD5mGrOzrg43T5refa5n1R4AcJnTVU8jJv4iMgZ2nr6gZLSViMjXr6TSv1VdDRaHXttG0sPEM1wvQ3GmwQ0FH0LvBPTQS8i38UyznoAPJKxmyd80na1u1maoyfQ==',key_name='tempest-keypair-72257052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='057af934a5324de19a6c05e2a0379f92',ramdisk_id='',reservation_id='r-24tr0uzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-499333430',owner_user_name='tempest-SnapshotDataIntegrityTests-499333430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:09:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d775cbe0387444bb85fcef28385a65c',uuid=2c382d73-f36e-40e9-aec9-ce8c67a84641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Converting VIF {"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:09:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:09:37 user nova-compute[75703]:   <uuid>2c382d73-f36e-40e9-aec9-ce8c67a84641</uuid>
Nov 10 15:09:37 user nova-compute[75703]:   <name>instance-0000002c</name>
Nov 10 15:09:37 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:09:37 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:09:37 user nova-compute[75703]:   <metadata>
Nov 10 15:09:37 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:09:37 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:09:37 user nova-compute[75703]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1081710307</nova:name>
Nov 10 15:09:37 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:09:37</nova:creationTime>
Nov 10 15:09:37 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:09:37 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:09:37 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:09:37 user nova-compute[75703]:       <nova:owner>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:user uuid="4d775cbe0387444bb85fcef28385a65c">tempest-SnapshotDataIntegrityTests-499333430-project-member</nova:user>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:project uuid="057af934a5324de19a6c05e2a0379f92">tempest-SnapshotDataIntegrityTests-499333430</nova:project>
Nov 10 15:09:37 user nova-compute[75703]:       </nova:owner>
Nov 10 15:09:37 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:09:37 user nova-compute[75703]:       <nova:ports>
Nov 10 15:09:37 user nova-compute[75703]:         <nova:port uuid="b7c0f108-248d-4cc7-8f98-310482a30009">
Nov 10 15:09:37 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 15:09:37 user nova-compute[75703]:         </nova:port>
Nov 10 15:09:37 user nova-compute[75703]:       </nova:ports>
Nov 10 15:09:37 user nova-compute[75703]:     </nova:instance>
Nov 10 15:09:37 user nova-compute[75703]:   </metadata>
Nov 10 15:09:37 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:09:37 user nova-compute[75703]:     <system>
Nov 10 15:09:37 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:09:37 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:09:37 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:09:37 user nova-compute[75703]:       <entry name="serial">2c382d73-f36e-40e9-aec9-ce8c67a84641</entry>
Nov 10 15:09:37 user nova-compute[75703]:       <entry name="uuid">2c382d73-f36e-40e9-aec9-ce8c67a84641</entry>
Nov 10 15:09:37 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:09:37 user nova-compute[75703]:     </system>
Nov 10 15:09:37 user nova-compute[75703]:   </sysinfo>
Nov 10 15:09:37 user nova-compute[75703]:   <os>
Nov 10 15:09:37 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:09:37 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:09:37 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:09:37 user nova-compute[75703]:   </os>
Nov 10 15:09:37 user nova-compute[75703]:   <features>
Nov 10 15:09:37 user nova-compute[75703]:     <acpi/>
Nov 10 15:09:37 user nova-compute[75703]:     <apic/>
Nov 10 15:09:37 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:09:37 user nova-compute[75703]:   </features>
Nov 10 15:09:37 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:09:37 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:09:37 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:09:37 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:09:37 user nova-compute[75703]:   </clock>
Nov 10 15:09:37 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:09:37 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:09:37 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:09:37 user nova-compute[75703]:   </cpu>
Nov 10 15:09:37 user nova-compute[75703]:   <devices>
Nov 10 15:09:37 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:09:37 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:09:37 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk"/>
Nov 10 15:09:37 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:09:37 user nova-compute[75703]:     </disk>
Nov 10 15:09:37 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:09:37 user nova-compute[75703]:       <mac address="fa:16:3e:68:8d:e6"/>
Nov 10 15:09:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:09:37 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:09:37 user nova-compute[75703]:       <target dev="tapb7c0f108-24"/>
Nov 10 15:09:37 user nova-compute[75703]:     </interface>
Nov 10 15:09:37 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:09:37 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/console.log" append="off"/>
Nov 10 15:09:37 user nova-compute[75703]:     </serial>
Nov 10 15:09:37 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:09:37 user nova-compute[75703]:     <video>
Nov 10 15:09:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:09:37 user nova-compute[75703]:     </video>
Nov 10 15:09:37 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:09:37 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:09:37 user nova-compute[75703]:     </rng>
Nov 10 15:09:37 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:09:37 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:09:37 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:09:37 user nova-compute[75703]:     </memballoon>
Nov 10 15:09:37 user nova-compute[75703]:   </devices>
Nov 10 15:09:37 user nova-compute[75703]: </domain>
Nov 10 15:09:37 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1081710307',display_name='tempest-SnapshotDataIntegrityTests-server-1081710307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1081710307',id=44,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlKmybVD5mGrOzrg43T5refa5n1R4AcJnTVU8jJv4iMgZ2nr6gZLSViMjXr6TSv1VdDRaHXttG0sPEM1wvQ3GmwQ0FH0LvBPTQS8i38UyznoAPJKxmyd80na1u1maoyfQ==',key_name='tempest-keypair-72257052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='057af934a5324de19a6c05e2a0379f92',ramdisk_id='',reservation_id='r-24tr0uzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-499333430',owner_user_name='tempest-SnapshotDataIntegrityTests-499333430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:09:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d775cbe0387444bb85fcef28385a65c',uuid=2c382d73-f36e-40e9-aec9-ce8c67a84641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Converting VIF {"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG os_vif [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32045611-d5cf-565f-b8fa-ac6aebbbef3d', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7c0f108-24, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7c0f108-24, col_values=(('qos', UUID('0a1cc146-f2fe-4f53-8ccf-3156ee79b6f5')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7c0f108-24, col_values=(('external_ids', {'iface-id': 'b7c0f108-248d-4cc7-8f98-310482a30009', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:8d:e6', 'vm-uuid': '2c382d73-f36e-40e9-aec9-ce8c67a84641'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:37 user nova-compute[75703]: INFO os_vif [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24')
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.policy [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1344068e16644f45bc9cb08cc0815b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52077a8ebd4f33ad9bc320ac3280fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No VIF found with MAC fa:16:3e:68:8d:e6, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:09:37 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Creating image(s)
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "/opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updated VIF entry in instance network info cache for port b7c0f108-248d-4cc7-8f98-310482a30009. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e1059cd7-04c7-46ca-ba87-5aaabc5ffea2 req-6fc2e23c-f7b0-43f3-b368-bb70d8b68dc5 service nova] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk 1073741824" returned: 0 in 0.055s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Successfully created port: 69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Cannot resize image /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Ensure instance console log exists: /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Successfully updated port: 69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquired lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:09:38 user nova-compute[75703]: DEBUG nova.network.neutron [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-changed-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Refreshing instance network info cache due to event network-changed-69e4a57b-d706-4230-8f71-faad4ffef57a. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] Acquiring lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.neutron [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.neutron [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating instance_info_cache with network_info: [{"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Releasing lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Instance network_info: |[{"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] Acquired lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Refreshing network info cache for port 69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Start _get_guest_xml network_info=[{"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:09:39 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:39 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-5195052',display_name='tempest-AttachVolumeNegativeTest-server-5195052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-5195052',id=45,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGb+dKwLo+/O1OY1t3HAoENGdaZLRMab2FiGkTykh3Tyg4bMkI87SBD3HoanUa4PyLFxOye4OaZa0Tkz1ghB/lS4wWXdY6UtsYo6oe3ouhWya/VYw/eeYX+OQwx5DRpKg==',key_name='tempest-keypair-1425767327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-d01qmaxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=d036404a-0828-40c3-afb4-b29ada8c5c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'pci_devices' on Instance uuid d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:09:39 user nova-compute[75703]:   <uuid>d036404a-0828-40c3-afb4-b29ada8c5c4b</uuid>
Nov 10 15:09:39 user nova-compute[75703]:   <name>instance-0000002d</name>
Nov 10 15:09:39 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:09:39 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:09:39 user nova-compute[75703]:   <metadata>
Nov 10 15:09:39 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:09:39 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:09:39 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeNegativeTest-server-5195052</nova:name>
Nov 10 15:09:39 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:09:39</nova:creationTime>
Nov 10 15:09:39 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:09:39 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:09:39 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:09:39 user nova-compute[75703]:       <nova:owner>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:user uuid="1344068e16644f45bc9cb08cc0815b13">tempest-AttachVolumeNegativeTest-1477766545-project-member</nova:user>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:project uuid="ea52077a8ebd4f33ad9bc320ac3280fc">tempest-AttachVolumeNegativeTest-1477766545</nova:project>
Nov 10 15:09:39 user nova-compute[75703]:       </nova:owner>
Nov 10 15:09:39 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:09:39 user nova-compute[75703]:       <nova:ports>
Nov 10 15:09:39 user nova-compute[75703]:         <nova:port uuid="69e4a57b-d706-4230-8f71-faad4ffef57a">
Nov 10 15:09:39 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 15:09:39 user nova-compute[75703]:         </nova:port>
Nov 10 15:09:39 user nova-compute[75703]:       </nova:ports>
Nov 10 15:09:39 user nova-compute[75703]:     </nova:instance>
Nov 10 15:09:39 user nova-compute[75703]:   </metadata>
Nov 10 15:09:39 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:09:39 user nova-compute[75703]:     <system>
Nov 10 15:09:39 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:09:39 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:09:39 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:09:39 user nova-compute[75703]:       <entry name="serial">d036404a-0828-40c3-afb4-b29ada8c5c4b</entry>
Nov 10 15:09:39 user nova-compute[75703]:       <entry name="uuid">d036404a-0828-40c3-afb4-b29ada8c5c4b</entry>
Nov 10 15:09:39 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:09:39 user nova-compute[75703]:     </system>
Nov 10 15:09:39 user nova-compute[75703]:   </sysinfo>
Nov 10 15:09:39 user nova-compute[75703]:   <os>
Nov 10 15:09:39 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:09:39 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:09:39 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:09:39 user nova-compute[75703]:   </os>
Nov 10 15:09:39 user nova-compute[75703]:   <features>
Nov 10 15:09:39 user nova-compute[75703]:     <acpi/>
Nov 10 15:09:39 user nova-compute[75703]:     <apic/>
Nov 10 15:09:39 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:09:39 user nova-compute[75703]:   </features>
Nov 10 15:09:39 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:09:39 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:09:39 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:09:39 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:09:39 user nova-compute[75703]:   </clock>
Nov 10 15:09:39 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:09:39 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:09:39 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:09:39 user nova-compute[75703]:   </cpu>
Nov 10 15:09:39 user nova-compute[75703]:   <devices>
Nov 10 15:09:39 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:09:39 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:09:39 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk"/>
Nov 10 15:09:39 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:09:39 user nova-compute[75703]:     </disk>
Nov 10 15:09:39 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:09:39 user nova-compute[75703]:       <mac address="fa:16:3e:04:c0:81"/>
Nov 10 15:09:39 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:09:39 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:09:39 user nova-compute[75703]:       <target dev="tap69e4a57b-d7"/>
Nov 10 15:09:39 user nova-compute[75703]:     </interface>
Nov 10 15:09:39 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:09:39 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/console.log" append="off"/>
Nov 10 15:09:39 user nova-compute[75703]:     </serial>
Nov 10 15:09:39 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:09:39 user nova-compute[75703]:     <video>
Nov 10 15:09:39 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:09:39 user nova-compute[75703]:     </video>
Nov 10 15:09:39 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:09:39 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:09:39 user nova-compute[75703]:     </rng>
Nov 10 15:09:39 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:09:39 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:09:39 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:09:39 user nova-compute[75703]:     </memballoon>
Nov 10 15:09:39 user nova-compute[75703]:   </devices>
Nov 10 15:09:39 user nova-compute[75703]: </domain>
Nov 10 15:09:39 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-5195052',display_name='tempest-AttachVolumeNegativeTest-server-5195052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-5195052',id=45,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGb+dKwLo+/O1OY1t3HAoENGdaZLRMab2FiGkTykh3Tyg4bMkI87SBD3HoanUa4PyLFxOye4OaZa0Tkz1ghB/lS4wWXdY6UtsYo6oe3ouhWya/VYw/eeYX+OQwx5DRpKg==',key_name='tempest-keypair-1425767327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-d01qmaxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=d036404a-0828-40c3-afb4-b29ada8c5c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG os_vif [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '707aedab-cb4d-56a6-8ae7-02652f9e4518', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69e4a57b-d7, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69e4a57b-d7, col_values=(('qos', UUID('a6ad7739-3b68-492f-821c-77de0b575c9f')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69e4a57b-d7, col_values=(('external_ids', {'iface-id': '69e4a57b-d706-4230-8f71-faad4ffef57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:c0:81', 'vm-uuid': 'd036404a-0828-40c3-afb4-b29ada8c5c4b'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:39 user nova-compute[75703]: INFO os_vif [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7')
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:04:c0:81, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:09:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updated VIF entry in instance network info cache for port 69e4a57b-d706-4230-8f71-faad4ffef57a. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:09:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating instance_info_cache with network_info: [{"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:09:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-3035c569-7f1f-4841-b628-edf5b0d589e9 req-7c3ade14-4834-46bc-b4ae-99467f33c024 service nova] Releasing lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] No waiting events found dispatching network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:09:41 user nova-compute[75703]: WARNING nova.compute.manager [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received unexpected event network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 for instance with vm_state building and task_state spawning.
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] No waiting events found dispatching network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:09:41 user nova-compute[75703]: WARNING nova.compute.manager [req-7a6d8cd3-2eb1-49e3-9c58-d0f716199855 req-8ae5a5f5-6935-45dc-bd6a-324eb824a35d service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received unexpected event network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 for instance with vm_state building and task_state spawning.
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:09:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Instance spawned successfully.
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:41 user nova-compute[75703]: INFO nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:09:41 user nova-compute[75703]: INFO nova.compute.manager [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Took 7.03 seconds to build instance.
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e941d09d-d4f2-4183-a115-143d23518441 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.149s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-ed9da2c4-9834-4025-8fd0-64f1630a907f req-fceb165b-8092-4c70-94fc-990d857269e1 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ed9da2c4-9834-4025-8fd0-64f1630a907f req-fceb165b-8092-4c70-94fc-990d857269e1 service nova] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ed9da2c4-9834-4025-8fd0-64f1630a907f req-fceb165b-8092-4c70-94fc-990d857269e1 service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ed9da2c4-9834-4025-8fd0-64f1630a907f req-fceb165b-8092-4c70-94fc-990d857269e1 service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-ed9da2c4-9834-4025-8fd0-64f1630a907f req-fceb165b-8092-4c70-94fc-990d857269e1 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] No waiting events found dispatching network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:09:41 user nova-compute[75703]: WARNING nova.compute.manager [req-ed9da2c4-9834-4025-8fd0-64f1630a907f req-fceb165b-8092-4c70-94fc-990d857269e1 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received unexpected event network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a for instance with vm_state building and task_state spawning.
Nov 10 15:09:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_power_states {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid b161728d-6d17-43a4-9663-37d7727f3b6b {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-40ebf483-2541-4dfe-9ba5-2824bdb18972 req-2fa9c14e-9902-4fb1-b2d5-75d0b62a15ee service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-40ebf483-2541-4dfe-9ba5-2824bdb18972 req-2fa9c14e-9902-4fb1-b2d5-75d0b62a15ee service nova] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-40ebf483-2541-4dfe-9ba5-2824bdb18972 req-2fa9c14e-9902-4fb1-b2d5-75d0b62a15ee service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-40ebf483-2541-4dfe-9ba5-2824bdb18972 req-2fa9c14e-9902-4fb1-b2d5-75d0b62a15ee service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-40ebf483-2541-4dfe-9ba5-2824bdb18972 req-2fa9c14e-9902-4fb1-b2d5-75d0b62a15ee service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] No waiting events found dispatching network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:09:44 user nova-compute[75703]: WARNING nova.compute.manager [req-40ebf483-2541-4dfe-9ba5-2824bdb18972 req-2fa9c14e-9902-4fb1-b2d5-75d0b62a15ee service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received unexpected event network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a for instance with vm_state building and task_state spawning.
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:09:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Instance spawned successfully.
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:09:44 user nova-compute[75703]: INFO nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 10 15:09:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:09:44 user nova-compute[75703]: INFO nova.compute.manager [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Took 7.72 seconds to build instance.
Nov 10 15:09:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-208dabcf-7696-4acc-be46-a188c139a37f tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.855s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.485s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:44 user nova-compute[75703]: INFO nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 15:09:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:54 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b84f952d-98ef-41c8-b2e1-313a5b553544 is timed out.
Nov 10 15:09:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully detached device vdb from instance b84f952d-98ef-41c8-b2e1-313a5b553544 from the live domain config.
Nov 10 15:09:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoDQyCIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:09:54 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[017aee3c-d4c8-4e63-a08c-8e42819092df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:09:54 user nova-compute[75703]: No targets found.
Nov 10 15:09:54 user nova-compute[75703]: iSNS:
Nov 10 15:09:54 user nova-compute[75703]: No targets found.
Nov 10 15:09:54 user nova-compute[75703]: STATIC:
Nov 10 15:09:54 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7
Nov 10 15:09:54 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:09:54 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:09:54 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550
Nov 10 15:09:54 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:09:54 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:09:54 user nova-compute[75703]: FIRMWARE:
Nov 10 15:09:54 user nova-compute[75703]: No targets found.
Nov 10 15:09:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:09:54 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:09:54 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[def658b7-7333-4801-a3c3-0bba304d9688]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dcd6fe-2579-4f1d-92fb-3110e0dcd5ab]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:54 user nova-compute[75703]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:09:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 (non-flash)
Nov 10 15:09:54 user nova-compute[75703]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:09:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a41b17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c670e7e7-5cec-4ee8-9d55-4212c463d1c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d833ba3-2627-421b-a00d-e65589789087]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80e2603-6487-4281-8cdb-80b8677fc36a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29f4e51-b142-4ca5-9b6a-eab614168316]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50aaadb-2514-4aa1-873d-a9c749cc3118]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bcbfe6-377d-475b-9945-cc06aa54fde7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260]
Nov 10 15:09:54 user nova-compute[75703]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550, portal: 172.16.0.220,3260] successful.
Nov 10 15:09:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ce5c7f-3b2e-4354-919a-d937e0c85550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7233aa-1100-423f-bad2-c5f227cc87bb]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] <== disconnect_volume: return (344ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:55 user nova-compute[75703]: DEBUG nova.objects.instance [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'flavor' on Instance uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:09:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bb4b1ec9-0289-4ef8-b77c-84148163b8cb tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.262s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.752s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:09:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:09:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:09:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:07 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:10:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:16 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:10:16 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8269MB free_disk=24.99721908569336GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b161728d-6d17-43a4-9663-37d7727f3b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d036404a-0828-40c3-afb4-b29ada8c5c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:10:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:10:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:10:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:10:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:10:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:10:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:10:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:10:38 user nova-compute[75703]: INFO nova.compute.manager [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] instance snapshotting
Nov 10 15:10:38 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Beginning live snapshot process
Nov 10 15:10:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json -f qcow2 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json -f qcow2" returned: 0 in 0.230s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptbvpcbe9/58ba9bef1a0f4ec59f992d50dc608e41.delta 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:39 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptbvpcbe9/58ba9bef1a0f4ec59f992d50dc608e41.delta 1073741824" returned: 0 in 0.052s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 15:10:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-changed-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Refreshing instance network info cache due to event network-changed-fa4231eb-75f4-4b08-81c4-58e77b263859. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] Acquiring lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] Acquired lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Refreshing network info cache for port fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] COPY block job progress, current cursor: 26935296 final cursor: 75563008 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updated VIF entry in instance network info cache for port fa4231eb-75f4-4b08-81c4-58e77b263859. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.network.neutron [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating instance_info_cache with network_info: [{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-9d72f335-5a4d-4f8c-84d7-54c68ac0d577 req-52a4645d-96d2-463f-b58c-e0d9b61f4acb service nova] Releasing lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:10:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75703) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 15:10:40 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 15:10:41 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 15:10:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptbvpcbe9/58ba9bef1a0f4ec59f992d50dc608e41.delta /opt/stack/data/nova/instances/snapshots/tmptbvpcbe9/58ba9bef1a0f4ec59f992d50dc608e41 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:41 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptbvpcbe9/58ba9bef1a0f4ec59f992d50dc608e41.delta /opt/stack/data/nova/instances/snapshots/tmptbvpcbe9/58ba9bef1a0f4ec59f992d50dc608e41" returned: 0 in 0.789s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Snapshot extracted, beginning image upload
Nov 10 15:10:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Snapshot image upload complete
Nov 10 15:10:44 user nova-compute[75703]: INFO nova.compute.manager [None req-46804215-7908-46ac-bcc0-2f0b222b535a tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Took 6.30 seconds to snapshot the instance on the hypervisor.
Nov 10 15:10:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:10:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:10:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:10:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:10:47 user nova-compute[75703]: INFO nova.compute.claims [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Claim successful on node user
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.network.neutron [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:10:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.policy [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23d189e700bd40ed8ee23d74de3a0681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9763add2a3741d1a75370ee532cc2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:10:47 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Creating image(s)
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "/opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "/opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "/opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "457f1cda5eda07dffad5f32abf2d8d8cdd7534f0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "457f1cda5eda07dffad5f32abf2d8d8cdd7534f0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.part --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG nova.network.neutron [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Successfully created port: c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG nova.virt.images [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] d8668dee-ca5a-48c0-b6de-20fabe803f7a was qcow2, converting to raw {{(pid=75703) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG nova.privsep.utils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75703) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.part /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.converted {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Successfully updated port: c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquired lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-changed-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.compute.manager [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Refreshing instance network info cache due to event network-changed-c7f0c11a-bc34-48b5-85f8-d4026282ae25. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] Acquiring lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.part /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.converted" returned: 0 in 1.273s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.converted --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.network.neutron [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating instance_info_cache with network_info: [{"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "457f1cda5eda07dffad5f32abf2d8d8cdd7534f0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.188s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Releasing lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Instance network_info: |[{"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] Acquired lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:10:50 user nova-compute[75703]: DEBUG nova.network.neutron [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Refreshing network info cache for port c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "457f1cda5eda07dffad5f32abf2d8d8cdd7534f0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "457f1cda5eda07dffad5f32abf2d8d8cdd7534f0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 --force-share --output=json" returned: 0 in 0.211s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0,backing_fmt=raw /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.network.neutron [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updated VIF entry in instance network info cache for port c7f0c11a-bc34-48b5-85f8-d4026282ae25. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.network.neutron [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating instance_info_cache with network_info: [{"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0,backing_fmt=raw /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk 1073741824" returned: 0 in 0.078s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "457f1cda5eda07dffad5f32abf2d8d8cdd7534f0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-aa5dd027-f32c-4a26-ba12-ee128b8959b1 req-1e962424-db4e-436f-b4f1-487e3224be82 service nova] Releasing lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Ensure instance console log exists: /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Start _get_guest_xml network_info=[{"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a5b956224598638008b8dde7b29716f8',container_format='bare',created_at=2023-11-10T15:10:38Z,direct_url=<?>,disk_format='qcow2',id=d8668dee-ca5a-48c0-b6de-20fabe803f7a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-686936921',owner='c9763add2a3741d1a75370ee532cc2a3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T15:10:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': 'd8668dee-ca5a-48c0-b6de-20fabe803f7a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:10:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:10:51 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a5b956224598638008b8dde7b29716f8',container_format='bare',created_at=2023-11-10T15:10:38Z,direct_url=<?>,disk_format='qcow2',id=d8668dee-ca5a-48c0-b6de-20fabe803f7a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-686936921',owner='c9763add2a3741d1a75370ee532cc2a3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T15:10:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1999150527',display_name='tempest-TestStampPattern-server-1999150527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1999150527',id=46,image_ref='d8668dee-ca5a-48c0-b6de-20fabe803f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnBXfBlOXi2aS+QsQoo4WrpyvXZk+kDG3vQXqkaS4Sck7gWlnx2z2npznqQCZiwOuw3oc2sro6uqziSWJxc6dsLg3QQ16Ey8DOQXS+LIVfU5uH0OsAz1r4O0pGf39XV3w==',key_name='tempest-TestStampPattern-32336318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9763add2a3741d1a75370ee532cc2a3',ramdisk_id='',reservation_id='r-epe7k8vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b84f952d-98ef-41c8-b2e1-313a5b553544',image_min_disk='1',image_min_ram='0',image_owner_id='c9763add2a3741d1a75370ee532cc2a3',image_owner_project_name='tempest-TestStampPattern-1606130469',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1606130469-project-member',image_user_id='23d189e700bd40ed8ee23d74de3a0681',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606130469',owner_user_name='tempest-TestStampPattern-1606130469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:10:48Z,user_data=None,user_id='23d189e700bd40ed8ee23d74de3a0681',uuid=e083d89b-6aff-4ca8-9ce9-929ba9236fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converting VIF {"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.objects.instance [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'pci_devices' on Instance uuid e083d89b-6aff-4ca8-9ce9-929ba9236fe5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:10:51 user nova-compute[75703]:   <uuid>e083d89b-6aff-4ca8-9ce9-929ba9236fe5</uuid>
Nov 10 15:10:51 user nova-compute[75703]:   <name>instance-0000002e</name>
Nov 10 15:10:51 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:10:51 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:10:51 user nova-compute[75703]:   <metadata>
Nov 10 15:10:51 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:10:51 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:10:51 user nova-compute[75703]:       <nova:name>tempest-TestStampPattern-server-1999150527</nova:name>
Nov 10 15:10:51 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:10:51</nova:creationTime>
Nov 10 15:10:51 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:10:51 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:10:51 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:10:51 user nova-compute[75703]:       <nova:owner>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:user uuid="23d189e700bd40ed8ee23d74de3a0681">tempest-TestStampPattern-1606130469-project-member</nova:user>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:project uuid="c9763add2a3741d1a75370ee532cc2a3">tempest-TestStampPattern-1606130469</nova:project>
Nov 10 15:10:51 user nova-compute[75703]:       </nova:owner>
Nov 10 15:10:51 user nova-compute[75703]:       <nova:root type="image" uuid="d8668dee-ca5a-48c0-b6de-20fabe803f7a"/>
Nov 10 15:10:51 user nova-compute[75703]:       <nova:ports>
Nov 10 15:10:51 user nova-compute[75703]:         <nova:port uuid="c7f0c11a-bc34-48b5-85f8-d4026282ae25">
Nov 10 15:10:51 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 15:10:51 user nova-compute[75703]:         </nova:port>
Nov 10 15:10:51 user nova-compute[75703]:       </nova:ports>
Nov 10 15:10:51 user nova-compute[75703]:     </nova:instance>
Nov 10 15:10:51 user nova-compute[75703]:   </metadata>
Nov 10 15:10:51 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:10:51 user nova-compute[75703]:     <system>
Nov 10 15:10:51 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:10:51 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:10:51 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:10:51 user nova-compute[75703]:       <entry name="serial">e083d89b-6aff-4ca8-9ce9-929ba9236fe5</entry>
Nov 10 15:10:51 user nova-compute[75703]:       <entry name="uuid">e083d89b-6aff-4ca8-9ce9-929ba9236fe5</entry>
Nov 10 15:10:51 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:10:51 user nova-compute[75703]:     </system>
Nov 10 15:10:51 user nova-compute[75703]:   </sysinfo>
Nov 10 15:10:51 user nova-compute[75703]:   <os>
Nov 10 15:10:51 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:10:51 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:10:51 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:10:51 user nova-compute[75703]:   </os>
Nov 10 15:10:51 user nova-compute[75703]:   <features>
Nov 10 15:10:51 user nova-compute[75703]:     <acpi/>
Nov 10 15:10:51 user nova-compute[75703]:     <apic/>
Nov 10 15:10:51 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:10:51 user nova-compute[75703]:   </features>
Nov 10 15:10:51 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:10:51 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:10:51 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:10:51 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:10:51 user nova-compute[75703]:   </clock>
Nov 10 15:10:51 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:10:51 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:10:51 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:10:51 user nova-compute[75703]:   </cpu>
Nov 10 15:10:51 user nova-compute[75703]:   <devices>
Nov 10 15:10:51 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:10:51 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:10:51 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk"/>
Nov 10 15:10:51 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:10:51 user nova-compute[75703]:     </disk>
Nov 10 15:10:51 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:10:51 user nova-compute[75703]:       <mac address="fa:16:3e:c9:9f:30"/>
Nov 10 15:10:51 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:10:51 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:10:51 user nova-compute[75703]:       <target dev="tapc7f0c11a-bc"/>
Nov 10 15:10:51 user nova-compute[75703]:     </interface>
Nov 10 15:10:51 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:10:51 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/console.log" append="off"/>
Nov 10 15:10:51 user nova-compute[75703]:     </serial>
Nov 10 15:10:51 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:10:51 user nova-compute[75703]:     <video>
Nov 10 15:10:51 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:10:51 user nova-compute[75703]:     </video>
Nov 10 15:10:51 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:10:51 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:10:51 user nova-compute[75703]:     </rng>
Nov 10 15:10:51 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:10:51 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:10:51 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:10:51 user nova-compute[75703]:     </memballoon>
Nov 10 15:10:51 user nova-compute[75703]:   </devices>
Nov 10 15:10:51 user nova-compute[75703]: </domain>
Nov 10 15:10:51 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1999150527',display_name='tempest-TestStampPattern-server-1999150527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1999150527',id=46,image_ref='d8668dee-ca5a-48c0-b6de-20fabe803f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnBXfBlOXi2aS+QsQoo4WrpyvXZk+kDG3vQXqkaS4Sck7gWlnx2z2npznqQCZiwOuw3oc2sro6uqziSWJxc6dsLg3QQ16Ey8DOQXS+LIVfU5uH0OsAz1r4O0pGf39XV3w==',key_name='tempest-TestStampPattern-32336318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9763add2a3741d1a75370ee532cc2a3',ramdisk_id='',reservation_id='r-epe7k8vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b84f952d-98ef-41c8-b2e1-313a5b553544',image_min_disk='1',image_min_ram='0',image_owner_id='c9763add2a3741d1a75370ee532cc2a3',image_owner_project_name='tempest-TestStampPattern-1606130469',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1606130469-project-member',image_user_id='23d189e700bd40ed8ee23d74de3a0681',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606130469',owner_user_name='tempest-TestStampPattern-1606130469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:10:48Z,user_data=None,user_id='23d189e700bd40ed8ee23d74de3a0681',uuid=e083d89b-6aff-4ca8-9ce9-929ba9236fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converting VIF {"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG os_vif [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dccd8a7-f2de-5293-be81-9cc9523db82c', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f0c11a-bc, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7f0c11a-bc, col_values=(('qos', UUID('06d78292-59db-4e03-8e3b-02d1fc17c964')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7f0c11a-bc, col_values=(('external_ids', {'iface-id': 'c7f0c11a-bc34-48b5-85f8-d4026282ae25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9f:30', 'vm-uuid': 'e083d89b-6aff-4ca8-9ce9-929ba9236fe5'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:51 user nova-compute[75703]: INFO os_vif [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc')
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:10:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No VIF found with MAC fa:16:3e:c9:9f:30, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-13a9a1b4-a222-4afa-892e-50a839b4c07a req-a5dce513-ba7d-437c-8376-eb11749166e9 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13a9a1b4-a222-4afa-892e-50a839b4c07a req-a5dce513-ba7d-437c-8376-eb11749166e9 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13a9a1b4-a222-4afa-892e-50a839b4c07a req-a5dce513-ba7d-437c-8376-eb11749166e9 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13a9a1b4-a222-4afa-892e-50a839b4c07a req-a5dce513-ba7d-437c-8376-eb11749166e9 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-13a9a1b4-a222-4afa-892e-50a839b4c07a req-a5dce513-ba7d-437c-8376-eb11749166e9 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:10:53 user nova-compute[75703]: WARNING nova.compute.manager [req-13a9a1b4-a222-4afa-892e-50a839b4c07a req-a5dce513-ba7d-437c-8376-eb11749166e9 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state building and task_state spawning.
Nov 10 15:10:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-91bdd834-7e4f-48b4-bb77-85bcf8e64fd0 req-4d8535f8-70d1-447a-9a6a-5dd138e2d1f7 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-91bdd834-7e4f-48b4-bb77-85bcf8e64fd0 req-4d8535f8-70d1-447a-9a6a-5dd138e2d1f7 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-91bdd834-7e4f-48b4-bb77-85bcf8e64fd0 req-4d8535f8-70d1-447a-9a6a-5dd138e2d1f7 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-91bdd834-7e4f-48b4-bb77-85bcf8e64fd0 req-4d8535f8-70d1-447a-9a6a-5dd138e2d1f7 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-91bdd834-7e4f-48b4-bb77-85bcf8e64fd0 req-4d8535f8-70d1-447a-9a6a-5dd138e2d1f7 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:10:55 user nova-compute[75703]: WARNING nova.compute.manager [req-91bdd834-7e4f-48b4-bb77-85bcf8e64fd0 req-4d8535f8-70d1-447a-9a6a-5dd138e2d1f7 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state building and task_state spawning.
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:10:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Instance spawned successfully.
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:10:55 user nova-compute[75703]: INFO nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Took 7.93 seconds to spawn the instance on the hypervisor.
Nov 10 15:10:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:10:55 user nova-compute[75703]: INFO nova.compute.manager [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Took 8.62 seconds to build instance.
Nov 10 15:10:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-348516e6-d18c-45f7-8585-a2bc0e2dea7c tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.733s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:10:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:11:01 user nova-compute[75703]: INFO nova.compute.claims [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Claim successful on node user
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:11:01 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.policy [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67a5a4845f164d8cba0951d82f2430e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c013cf84f8b414ba6d2d888ddc2ee1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:11:01 user nova-compute[75703]: INFO nova.virt.block_device [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Booting with volume 4a6f45a5-ad34-4808-950d-e35b59f2562f at /dev/vda
Nov 10 15:11:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG os_brick.utils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edea044-d518-474c-9caa-2c0c31c0500c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d298082-c2c5-4709-a15c-b5d3d9c01cb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[689b0742-6241-4750-91a7-794a13d2d843]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[10abbc0a-f52a-4018-933c-c2de73ae9600]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:11:01 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:11:01 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc3c5b0-0191-4324-b2ab-5aa27507ea46]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG os_brick.utils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:11:01 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating existing volume attachment record: 595e1641-ad41-4a81-9b38-7d5c0ba45688 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:11:02 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Successfully created port: 314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Successfully updated port: 314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-changed-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.compute.manager [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Refreshing instance network info cache due to event network-changed-314dcba0-671b-447e-849a-3e253f154865. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] Acquiring lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] Acquired lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Refreshing network info cache for port 314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-781fec61-a930-4d5f-bb54-063e50530cf7 req-7beac3e4-a325-419a-a736-4fb00a444747 service nova] Releasing lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquired lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.network.neutron [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating instance_info_cache with network_info: [{"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Releasing lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:11:03 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Instance network_info: |[{"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:11:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:11:09 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:09 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:11:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:11:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.402s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:15 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:17 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:11:17 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=24.848678588867188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b161728d-6d17-43a4-9663-37d7727f3b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d036404a-0828-40c3-afb4-b29ada8c5c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:11:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Skipping network cache update for instance because it is Building. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:11:18 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:11:19 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:11:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:11:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:11:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-changed-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Refreshing instance network info cache due to event network-changed-b7c0f108-248d-4cc7-8f98-310482a30009. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Refreshing network info cache for port b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updated VIF entry in instance network info cache for port b7c0f108-248d-4cc7-8f98-310482a30009. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:11:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-906d83cb-bffe-4949-a4f6-a8d6f13df5b1 req-7ae0447d-1d20-49b0-908f-6f9767d892d7 service nova] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-changed-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.compute.manager [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Refreshing instance network info cache due to event network-changed-69e4a57b-d706-4230-8f71-faad4ffef57a. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] Acquiring lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] Acquired lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.network.neutron [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Refreshing network info cache for port 69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:11:27 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Creating image(s)
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Did not create local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Ensure instance console log exists: /opt/stack/data/nova/instances/75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Start _get_guest_xml network_info=[{"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '595e1641-ad41-4a81-9b38-7d5c0ba45688', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxWcpUPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6', 'attached_at': '', 'detached_at': '', 'volume_id': '4a6f45a5-ad34-4808-950d-e35b59f2562f', 'serial': '4a6f45a5-ad34-4808-950d-e35b59f2562f'}, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:11:27 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:11:27 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxWcpUPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:11:27 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:11:27 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:11:27 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd44c3b-d76d-478d-baef-087184aca753]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:11:27 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[223666e9-f1b5-4190-876a-a3249355aef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f] added
Nov 10 15:11:27 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad4aef-cb7e-4683-8d58-678cd542a585]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95e83ca-d44a-4451-b659-eebfe812a4f7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxWcpUPM {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxWcpUPM" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[35286984-e6f0-4ab0-9a12-64fcc98ddf58]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxWcpUPM'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b7404-76ae-443f-8221-e170fc29b0c6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2496497a-b14d-41ed-909c-b87fb6c1c5e1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:11:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:11:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14dd6ca-6477-4fd2-ac4b-777cc287b894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260]
Nov 10 15:11:28 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260] successful.
Nov 10 15:11:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1db730-e793-4309-9d8a-fa7552ca6125]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updated VIF entry in instance network info cache for port 69e4a57b-d706-4230-8f71-faad4ffef57a. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating instance_info_cache with network_info: [{"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf02da2-8f12-4107-ab53-761fbed84652]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:11:28 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:11:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:11:28 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:11:28 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e5eb6b85-02cb-40f7-ba42-003d80fec0d6 req-3039d4d6-9ce7-4f46-bd3b-c14a3e2c22ce service nova] Releasing lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5652b8-a382-4f5e-a08e-1030a8c51436]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:11:28 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxWcpUPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26262626237613932', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262626237613932', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-374890813',display_name='tempest-TestVolumeBootPattern-server-374890813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-374890813',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-jolub14s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:11:02Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'pci_devices' on Instance uuid 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:11:29 user nova-compute[75703]:   <uuid>75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6</uuid>
Nov 10 15:11:29 user nova-compute[75703]:   <name>instance-0000002f</name>
Nov 10 15:11:29 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:11:29 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:11:29 user nova-compute[75703]:   <metadata>
Nov 10 15:11:29 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:11:29 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:11:29 user nova-compute[75703]:       <nova:name>tempest-TestVolumeBootPattern-server-374890813</nova:name>
Nov 10 15:11:29 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:11:27</nova:creationTime>
Nov 10 15:11:29 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:11:29 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:11:29 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:11:29 user nova-compute[75703]:       <nova:owner>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:user uuid="67a5a4845f164d8cba0951d82f2430e9">tempest-TestVolumeBootPattern-982390102-project-member</nova:user>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:project uuid="3c013cf84f8b414ba6d2d888ddc2ee1b">tempest-TestVolumeBootPattern-982390102</nova:project>
Nov 10 15:11:29 user nova-compute[75703]:       </nova:owner>
Nov 10 15:11:29 user nova-compute[75703]:       <nova:ports>
Nov 10 15:11:29 user nova-compute[75703]:         <nova:port uuid="314dcba0-671b-447e-849a-3e253f154865">
Nov 10 15:11:29 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 15:11:29 user nova-compute[75703]:         </nova:port>
Nov 10 15:11:29 user nova-compute[75703]:       </nova:ports>
Nov 10 15:11:29 user nova-compute[75703]:     </nova:instance>
Nov 10 15:11:29 user nova-compute[75703]:   </metadata>
Nov 10 15:11:29 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:11:29 user nova-compute[75703]:     <system>
Nov 10 15:11:29 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:11:29 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:11:29 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:11:29 user nova-compute[75703]:       <entry name="serial">75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6</entry>
Nov 10 15:11:29 user nova-compute[75703]:       <entry name="uuid">75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6</entry>
Nov 10 15:11:29 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:11:29 user nova-compute[75703]:     </system>
Nov 10 15:11:29 user nova-compute[75703]:   </sysinfo>
Nov 10 15:11:29 user nova-compute[75703]:   <os>
Nov 10 15:11:29 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:11:29 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:11:29 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:11:29 user nova-compute[75703]:   </os>
Nov 10 15:11:29 user nova-compute[75703]:   <features>
Nov 10 15:11:29 user nova-compute[75703]:     <acpi/>
Nov 10 15:11:29 user nova-compute[75703]:     <apic/>
Nov 10 15:11:29 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:11:29 user nova-compute[75703]:   </features>
Nov 10 15:11:29 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:11:29 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:11:29 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:11:29 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:11:29 user nova-compute[75703]:   </clock>
Nov 10 15:11:29 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:11:29 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:11:29 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:11:29 user nova-compute[75703]:   </cpu>
Nov 10 15:11:29 user nova-compute[75703]:   <devices>
Nov 10 15:11:29 user nova-compute[75703]:     <disk type="block" device="disk">
Nov 10 15:11:29 user nova-compute[75703]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:11:29 user nova-compute[75703]:       <source dev="/dev/sdb"/>
Nov 10 15:11:29 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:11:29 user nova-compute[75703]:       <serial>4a6f45a5-ad34-4808-950d-e35b59f2562f</serial>
Nov 10 15:11:29 user nova-compute[75703]:     </disk>
Nov 10 15:11:29 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:11:29 user nova-compute[75703]:       <mac address="fa:16:3e:6a:7f:08"/>
Nov 10 15:11:29 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:11:29 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:11:29 user nova-compute[75703]:       <target dev="tap314dcba0-67"/>
Nov 10 15:11:29 user nova-compute[75703]:     </interface>
Nov 10 15:11:29 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:11:29 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6/console.log" append="off"/>
Nov 10 15:11:29 user nova-compute[75703]:     </serial>
Nov 10 15:11:29 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:11:29 user nova-compute[75703]:     <video>
Nov 10 15:11:29 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:11:29 user nova-compute[75703]:     </video>
Nov 10 15:11:29 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:11:29 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:11:29 user nova-compute[75703]:     </rng>
Nov 10 15:11:29 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:11:29 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:11:29 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:11:29 user nova-compute[75703]:     </memballoon>
Nov 10 15:11:29 user nova-compute[75703]:   </devices>
Nov 10 15:11:29 user nova-compute[75703]: </domain>
Nov 10 15:11:29 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-374890813',display_name='tempest-TestVolumeBootPattern-server-374890813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-374890813',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-jolub14s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:11:02Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG os_vif [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '502e0bae-5bcb-5012-99ae-32f9e61c1464', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap314dcba0-67, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap314dcba0-67, col_values=(('qos', UUID('02862da3-2ba1-4643-9599-823a2600aae4')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap314dcba0-67, col_values=(('external_ids', {'iface-id': '314dcba0-671b-447e-849a-3e253f154865', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:7f:08', 'vm-uuid': '75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:29 user nova-compute[75703]: INFO os_vif [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67')
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:11:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] No VIF found with MAC fa:16:3e:6a:7f:08, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:11:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-e0f1ba09-8d18-4b6e-8c47-9963d0b7bd24 req-db294fc6-a054-4fa0-a800-021eab7f5779 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:11:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e0f1ba09-8d18-4b6e-8c47-9963d0b7bd24 req-db294fc6-a054-4fa0-a800-021eab7f5779 service nova] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e0f1ba09-8d18-4b6e-8c47-9963d0b7bd24 req-db294fc6-a054-4fa0-a800-021eab7f5779 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e0f1ba09-8d18-4b6e-8c47-9963d0b7bd24 req-db294fc6-a054-4fa0-a800-021eab7f5779 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-e0f1ba09-8d18-4b6e-8c47-9963d0b7bd24 req-db294fc6-a054-4fa0-a800-021eab7f5779 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] No waiting events found dispatching network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:11:31 user nova-compute[75703]: WARNING nova.compute.manager [req-e0f1ba09-8d18-4b6e-8c47-9963d0b7bd24 req-db294fc6-a054-4fa0-a800-021eab7f5779 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received unexpected event network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 for instance with vm_state building and task_state spawning.
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:11:33 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Instance spawned successfully.
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-5bdc1188-fe57-46f3-abbc-846de021ef68 req-cfbd2774-1185-4899-af95-0946caed3d33 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5bdc1188-fe57-46f3-abbc-846de021ef68 req-cfbd2774-1185-4899-af95-0946caed3d33 service nova] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5bdc1188-fe57-46f3-abbc-846de021ef68 req-cfbd2774-1185-4899-af95-0946caed3d33 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5bdc1188-fe57-46f3-abbc-846de021ef68 req-cfbd2774-1185-4899-af95-0946caed3d33 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.compute.manager [req-5bdc1188-fe57-46f3-abbc-846de021ef68 req-cfbd2774-1185-4899-af95-0946caed3d33 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] No waiting events found dispatching network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:11:33 user nova-compute[75703]: WARNING nova.compute.manager [req-5bdc1188-fe57-46f3-abbc-846de021ef68 req-cfbd2774-1185-4899-af95-0946caed3d33 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received unexpected event network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 for instance with vm_state building and task_state spawning.
Nov 10 15:11:33 user nova-compute[75703]: INFO nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:11:33 user nova-compute[75703]: INFO nova.compute.manager [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Took 32.40 seconds to build instance.
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-bd64e022-7a47-4f72-90f2-a2b30aa23882 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.542s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG nova.objects.instance [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:11:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:34 user nova-compute[75703]: INFO nova.compute.manager [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attaching volume 5195f214-34e3-474e-bf32-8a5217bf0499 to /dev/vdb
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.utils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6467cbc5-a7f8-4f13-baca-971d5c07f354]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0dce0b-8c2a-4acc-8e2a-b8d36dc9d126]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701134b-b263-49a4-b833-8687ef41e1b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7318e79-28c4-4cc3-83b6-0d522038597b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:11:34 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50dc1c1-32f2-4ce3-9209-16210d6949f8]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.utils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating existing volume attachment record: 374f8c06-fe07-445e-a054-a30fdf438912 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:11:34 user nova-compute[75703]: INFO nova.compute.manager [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Attaching volume 58987b59-b9f8-4493-b4a9-72bef5a25c07 to /dev/vdb
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.utils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[632eff5d-b77e-4602-b133-5370a1fb85ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38106f-ac3c-4823-847f-c849cbdf7c78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc123163-b602-4013-aedc-e36707ba8d88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8655e-81d2-4df5-9f5c-57c2410cfdbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:11:34 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:11:34 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85eb83b-6dae-41b8-86ea-40c46c2881f5]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG os_brick.utils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:11:34 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating existing volume attachment record: 0965d1cb-16c9-4906-a24c-1805fc47c7e6 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:11:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:11:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlEhYUPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:12:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:12:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:12:00 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d95f3-4776-4972-8b97-fd7c1bec4754]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:12:00 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde4571-4974-4d37-b251-f48e7659de3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499] added
Nov 10 15:12:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee512d6d-88bc-4d8a-bd6b-e568f9e16833]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d04d9-f3ec-407c-9f38-963826c4d3a4]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlEhYUPH {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlEhYUPH" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b664aba-8c68-4bea-b069-31e00d400e25]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlEhYUPH'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61690c-4134-4575-b482-264570d9dce6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d6003c-fec0-4dd6-b637-2a0bf9c4ba21]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:00 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:00 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf540a-3bea-4434-b1f7-be9c13b5a120]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260]
Nov 10 15:12:00 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260] successful.
Nov 10 15:12:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3c9bb9-6852-4df5-992b-f7893e22eda8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0247f8-e74c-4e2d-92e7-9eb505e6c474]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:00 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:00 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:00 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:00 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a710169b-7054-4af4-9356-27c24c7b7cc4]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:12:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlEhYUPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufWloUpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:12:01 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23139356564323565', 'path': '/dev/sdd'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139356564323565', 'path': '/dev/sdd'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.085s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:12:01 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:12:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:12:01 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:12:01 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG nova.objects.instance [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f99f7-6ef8-43ec-9c26-0076792bbd96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:12:02 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d8dcc-caf7-4e5d-819b-38280fe6ffa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07] added
Nov 10 15:12:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe6675-f4ce-4c86-a8d3-0b405789fbe3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:12:02 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:12:02 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 15:12:02 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:12:02 user nova-compute[75703]:   <serial>5195f214-34e3-474e-bf32-8a5217bf0499</serial>
Nov 10 15:12:02 user nova-compute[75703]: </disk>
Nov 10 15:12:02 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[873c71db-0449-4b21-a473-e155213194ef]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufWloUpN {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufWloUpN" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aba4b15-2c54-48cc-b977-7e81bf1f6ed6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ufWloUpN'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ec6eb-ebe2-4563-9019-f0db8b555c7d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[22722d17-026f-4928-97ec-783ee4f4647a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8dc029-00db-4e49-b175-d160a1d582b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260]
Nov 10 15:12:02 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260] successful.
Nov 10 15:12:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9e0219-39d3-4eea-9b0f-760182ec1112]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5349ba02-9deb-41a0-aa3e-739df3d48882]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:12:02 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ab8af-d78e-4a35-8a8c-1aabdca68000]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufWloUpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No VIF found with MAC fa:16:3e:68:8d:e6, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:12:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-988069b5-97c0-454a-84b0-5b1f03f68482 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.655s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '26530343332616463', 'path': '/dev/sde'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530343332616463', 'path': '/dev/sde'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG nova.objects.instance [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:12:03 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:12:03 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 15:12:03 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:12:03 user nova-compute[75703]:   <serial>58987b59-b9f8-4493-b4a9-72bef5a25c07</serial>
Nov 10 15:12:03 user nova-compute[75703]: </disk>
Nov 10 15:12:03 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:12:03 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:04:c0:81, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:12:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-a844f0bd-b96d-4ac8-b161-803f791ba958 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.412s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:07 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:12:08 user nova-compute[75703]: INFO nova.compute.claims [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Claim successful on node user
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:12:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.policy [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1344068e16644f45bc9cb08cc0815b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52077a8ebd4f33ad9bc320ac3280fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:12:08 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Creating image(s)
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.257s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:08 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.199s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk 1073741824" returned: 0 in 0.062s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Successfully created port: 983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.227s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Cannot resize image /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Ensure instance console log exists: /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Successfully updated port: 983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquired lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-changed-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Refreshing instance network info cache due to event network-changed-983f79b0-3ca8-4c61-8da1-40873962657d. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] Acquiring lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Updating instance_info_cache with network_info: [{"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Releasing lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Instance network_info: |[{"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] Acquired lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.neutron [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Refreshing network info cache for port 983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Start _get_guest_xml network_info=[{"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:12:10 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:12:10 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1956354809',display_name='tempest-AttachVolumeNegativeTest-server-1956354809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1956354809',id=48,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N+zvqrmWPkK3tmj6fVwl+b4gjnlf6da+R5HlhOKCfg/bQkHIhwgrjOLkXh1Eh48yJD3cFvl6IRUJsuWhRTe51VTmuOzdyUsSk2a3PoXBlYXmX3zWhqkEUGERAr/RqmA==',key_name='tempest-keypair-2115889348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-0vo4ols7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=9ac582d7-0457-4b97-8d71-837ceb19864d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ac582d7-0457-4b97-8d71-837ceb19864d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:12:10 user nova-compute[75703]:   <uuid>9ac582d7-0457-4b97-8d71-837ceb19864d</uuid>
Nov 10 15:12:10 user nova-compute[75703]:   <name>instance-00000030</name>
Nov 10 15:12:10 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:12:10 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:12:10 user nova-compute[75703]:   <metadata>
Nov 10 15:12:10 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:12:10 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:12:10 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1956354809</nova:name>
Nov 10 15:12:10 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:12:10</nova:creationTime>
Nov 10 15:12:10 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:12:10 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:12:10 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:12:10 user nova-compute[75703]:       <nova:owner>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:user uuid="1344068e16644f45bc9cb08cc0815b13">tempest-AttachVolumeNegativeTest-1477766545-project-member</nova:user>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:project uuid="ea52077a8ebd4f33ad9bc320ac3280fc">tempest-AttachVolumeNegativeTest-1477766545</nova:project>
Nov 10 15:12:10 user nova-compute[75703]:       </nova:owner>
Nov 10 15:12:10 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:12:10 user nova-compute[75703]:       <nova:ports>
Nov 10 15:12:10 user nova-compute[75703]:         <nova:port uuid="983f79b0-3ca8-4c61-8da1-40873962657d">
Nov 10 15:12:10 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 15:12:10 user nova-compute[75703]:         </nova:port>
Nov 10 15:12:10 user nova-compute[75703]:       </nova:ports>
Nov 10 15:12:10 user nova-compute[75703]:     </nova:instance>
Nov 10 15:12:10 user nova-compute[75703]:   </metadata>
Nov 10 15:12:10 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:12:10 user nova-compute[75703]:     <system>
Nov 10 15:12:10 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:12:10 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:12:10 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:12:10 user nova-compute[75703]:       <entry name="serial">9ac582d7-0457-4b97-8d71-837ceb19864d</entry>
Nov 10 15:12:10 user nova-compute[75703]:       <entry name="uuid">9ac582d7-0457-4b97-8d71-837ceb19864d</entry>
Nov 10 15:12:10 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:12:10 user nova-compute[75703]:     </system>
Nov 10 15:12:10 user nova-compute[75703]:   </sysinfo>
Nov 10 15:12:10 user nova-compute[75703]:   <os>
Nov 10 15:12:10 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:12:10 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:12:10 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:12:10 user nova-compute[75703]:   </os>
Nov 10 15:12:10 user nova-compute[75703]:   <features>
Nov 10 15:12:10 user nova-compute[75703]:     <acpi/>
Nov 10 15:12:10 user nova-compute[75703]:     <apic/>
Nov 10 15:12:10 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:12:10 user nova-compute[75703]:   </features>
Nov 10 15:12:10 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:12:10 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:12:10 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:12:10 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:12:10 user nova-compute[75703]:   </clock>
Nov 10 15:12:10 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:12:10 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:12:10 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:12:10 user nova-compute[75703]:   </cpu>
Nov 10 15:12:10 user nova-compute[75703]:   <devices>
Nov 10 15:12:10 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:12:10 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:12:10 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk"/>
Nov 10 15:12:10 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:12:10 user nova-compute[75703]:     </disk>
Nov 10 15:12:10 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:12:10 user nova-compute[75703]:       <mac address="fa:16:3e:a4:c5:d4"/>
Nov 10 15:12:10 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:12:10 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:12:10 user nova-compute[75703]:       <target dev="tap983f79b0-3c"/>
Nov 10 15:12:10 user nova-compute[75703]:     </interface>
Nov 10 15:12:10 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:12:10 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/console.log" append="off"/>
Nov 10 15:12:10 user nova-compute[75703]:     </serial>
Nov 10 15:12:10 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:12:10 user nova-compute[75703]:     <video>
Nov 10 15:12:10 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:12:10 user nova-compute[75703]:     </video>
Nov 10 15:12:10 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:12:10 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:12:10 user nova-compute[75703]:     </rng>
Nov 10 15:12:10 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:12:10 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:12:10 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:12:10 user nova-compute[75703]:     </memballoon>
Nov 10 15:12:10 user nova-compute[75703]:   </devices>
Nov 10 15:12:10 user nova-compute[75703]: </domain>
Nov 10 15:12:10 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1956354809',display_name='tempest-AttachVolumeNegativeTest-server-1956354809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1956354809',id=48,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N+zvqrmWPkK3tmj6fVwl+b4gjnlf6da+R5HlhOKCfg/bQkHIhwgrjOLkXh1Eh48yJD3cFvl6IRUJsuWhRTe51VTmuOzdyUsSk2a3PoXBlYXmX3zWhqkEUGERAr/RqmA==',key_name='tempest-keypair-2115889348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-0vo4ols7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=9ac582d7-0457-4b97-8d71-837ceb19864d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG os_vif [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d2fef70-6881-5839-bb33-a45fb6e26d6f', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap983f79b0-3c, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap983f79b0-3c, col_values=(('qos', UUID('88f51532-6b92-4ca7-9833-b195685d9877')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap983f79b0-3c, col_values=(('external_ids', {'iface-id': '983f79b0-3ca8-4c61-8da1-40873962657d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:c5:d4', 'vm-uuid': '9ac582d7-0457-4b97-8d71-837ceb19864d'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:10 user nova-compute[75703]: INFO os_vif [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c')
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:12:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:a4:c5:d4, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:12:11 user nova-compute[75703]: DEBUG nova.network.neutron [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Updated VIF entry in instance network info cache for port 983f79b0-3ca8-4c61-8da1-40873962657d. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:12:11 user nova-compute[75703]: DEBUG nova.network.neutron [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Updating instance_info_cache with network_info: [{"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-61f9df13-b88f-4c88-abf6-85ce06896125 req-b299d761-29f1-443b-825d-218e857b78f9 service nova] Releasing lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-23454367-f77f-402d-a6b3-2f86c8acf06b req-64238329-9433-4b9e-99de-7b251b2746dd service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23454367-f77f-402d-a6b3-2f86c8acf06b req-64238329-9433-4b9e-99de-7b251b2746dd service nova] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23454367-f77f-402d-a6b3-2f86c8acf06b req-64238329-9433-4b9e-99de-7b251b2746dd service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-23454367-f77f-402d-a6b3-2f86c8acf06b req-64238329-9433-4b9e-99de-7b251b2746dd service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:12 user nova-compute[75703]: DEBUG nova.compute.manager [req-23454367-f77f-402d-a6b3-2f86c8acf06b req-64238329-9433-4b9e-99de-7b251b2746dd service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] No waiting events found dispatching network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:12:12 user nova-compute[75703]: WARNING nova.compute.manager [req-23454367-f77f-402d-a6b3-2f86c8acf06b req-64238329-9433-4b9e-99de-7b251b2746dd service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received unexpected event network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d for instance with vm_state building and task_state spawning.
Nov 10 15:12:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:12:14 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Instance spawned successfully.
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-0b6e3787-dc63-45e7-ac77-b834d9b5b59f req-bdc9d7d5-b2da-4595-9250-d1cd881ff252 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b6e3787-dc63-45e7-ac77-b834d9b5b59f req-bdc9d7d5-b2da-4595-9250-d1cd881ff252 service nova] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b6e3787-dc63-45e7-ac77-b834d9b5b59f req-bdc9d7d5-b2da-4595-9250-d1cd881ff252 service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0b6e3787-dc63-45e7-ac77-b834d9b5b59f req-bdc9d7d5-b2da-4595-9250-d1cd881ff252 service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-0b6e3787-dc63-45e7-ac77-b834d9b5b59f req-bdc9d7d5-b2da-4595-9250-d1cd881ff252 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] No waiting events found dispatching network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:12:14 user nova-compute[75703]: WARNING nova.compute.manager [req-0b6e3787-dc63-45e7-ac77-b834d9b5b59f req-bdc9d7d5-b2da-4595-9250-d1cd881ff252 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received unexpected event network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d for instance with vm_state building and task_state spawning.
Nov 10 15:12:14 user nova-compute[75703]: INFO nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 10 15:12:14 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:12:14 user nova-compute[75703]: INFO nova.compute.manager [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Took 6.82 seconds to build instance.
Nov 10 15:12:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1b75eee5-4138-4a2c-993a-667e40a3d5aa tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.942s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:16 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:12:16 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:12:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:12:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:12:19 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:12:19 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=24.834251403808594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b161728d-6d17-43a4-9663-37d7727f3b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d036404a-0828-40c3-afb4-b29ada8c5c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ac582d7-0457-4b97-8d71-837ceb19864d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:12:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:12:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:20 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:12:20 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:12:20 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:12:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:12:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:12:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:12:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:12:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating instance_info_cache with network_info: [{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:12:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:12:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:23 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:23 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:23 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:12:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:12:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-changed-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Refreshing instance network info cache due to event network-changed-c7f0c11a-bc34-48b5-85f8-d4026282ae25. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] Acquiring lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] Acquired lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Refreshing network info cache for port c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updated VIF entry in instance network info cache for port c7f0c11a-bc34-48b5-85f8-d4026282ae25. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG nova.network.neutron [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating instance_info_cache with network_info: [{"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-5e874966-790f-40fe-a49c-df3b3de3449a req-086c3eef-108e-4db3-99d3-e58266c65936 service nova] Releasing lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:39 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'flavor' on Instance uuid e083d89b-6aff-4ca8-9ce9-929ba9236fe5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:40 user nova-compute[75703]: INFO nova.compute.manager [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Attaching volume 1d753fb7-1aab-40cf-969c-8f3491160f1e to /dev/vdb
Nov 10 15:12:40 user nova-compute[75703]: DEBUG os_brick.utils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3595a3b-4e16-4469-a2f5-8c6c4ef77ef4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.041s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac056413-4187-4cb7-a456-d3887c491ee3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d05aa-7c02-4111-92bb-b6055d702828]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99e3c28-777c-407c-8797-97f0a8adaf52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:12:40 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:12:40 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb2cd45-2c81-45fc-8323-f749fb8f2900]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG os_brick.utils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating existing volume attachment record: 1214989a-8d88-4139-b284-ea7801520fc8 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:12:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:49 user nova-compute[75703]: INFO nova.compute.manager [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Detaching volume 5195f214-34e3-474e-bf32-8a5217bf0499
Nov 10 15:12:49 user nova-compute[75703]: INFO nova.virt.block_device [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attempting to driver detach volume 5195f214-34e3-474e-bf32-8a5217bf0499 from mountpoint /dev/vdb
Nov 10 15:12:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Attempting to detach device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:12:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:12:49 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:12:49 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 15:12:49 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:12:49 user nova-compute[75703]:   <serial>5195f214-34e3-474e-bf32-8a5217bf0499</serial>
Nov 10 15:12:49 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:12:49 user nova-compute[75703]: </disk>
Nov 10 15:12:49 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:12:49 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config.
Nov 10 15:12:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:12:49 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:12:49 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:12:49 user nova-compute[75703]:   <source dev="/dev/sdd"/>
Nov 10 15:12:49 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:12:49 user nova-compute[75703]:   <serial>5195f214-34e3-474e-bf32-8a5217bf0499</serial>
Nov 10 15:12:49 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:12:49 user nova-compute[75703]: </disk>
Nov 10 15:12:49 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:12:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:12:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-changed-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:52 user nova-compute[75703]: DEBUG nova.compute.manager [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Refreshing instance network info cache due to event network-changed-314dcba0-671b-447e-849a-3e253f154865. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:12:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] Acquiring lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:12:52 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] Acquired lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:12:52 user nova-compute[75703]: DEBUG nova.network.neutron [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Refreshing network info cache for port 314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG nova.network.neutron [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updated VIF entry in instance network info cache for port 314dcba0-671b-447e-849a-3e253f154865. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG nova.network.neutron [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating instance_info_cache with network_info: [{"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6e45c83e-ef55-4a36-a32e-f9f7907603c3 req-46d86b88-55f1-484c-8129-f3b78ea99aa0 service nova] Releasing lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-changed-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Refreshing instance network info cache due to event network-changed-314dcba0-671b-447e-849a-3e253f154865. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] Acquiring lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] Acquired lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG nova.network.neutron [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Refreshing network info cache for port 314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:53 user nova-compute[75703]: INFO nova.compute.manager [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Terminating instance
Nov 10 15:12:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.network.neutron [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updated VIF entry in instance network info cache for port 314dcba0-671b-447e-849a-3e253f154865. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.network.neutron [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating instance_info_cache with network_info: [{"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4f182238-bf6e-496b-9977-cb085a23bd15 req-873b4dc1-a6c6-4d4e-bdcb-0bab88f4925d service nova] Releasing lock "refresh_cache-75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:12:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Instance destroyed successfully.
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'resources' on Instance uuid 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-374890813',display_name='tempest-TestVolumeBootPattern-server-374890813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-374890813',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-jolub14s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:11:33Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "314dcba0-671b-447e-849a-3e253f154865", "address": "fa:16:3e:6a:7f:08", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314dcba0-67", "ovs_interfaceid": "314dcba0-671b-447e-849a-3e253f154865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_vif [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap314dcba0-67, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02862da3-2ba1-4643-9599-823a2600aae4) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:54 user nova-compute[75703]: INFO os_vif [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7f:08,bridge_name='br-int',has_traffic_filtering=True,id=314dcba0-671b-447e-849a-3e253f154865,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314dcba0-67')
Nov 10 15:12:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxWcpUPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:12:54 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a19d74-b7db-4290-83e1-ed4b05e5359e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:12:54 user nova-compute[75703]: No targets found.
Nov 10 15:12:54 user nova-compute[75703]: iSNS:
Nov 10 15:12:54 user nova-compute[75703]: No targets found.
Nov 10 15:12:54 user nova-compute[75703]: STATIC:
Nov 10 15:12:54 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7
Nov 10 15:12:54 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:12:54 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:12:54 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:12:54 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:12:54 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:12:54 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f
Nov 10 15:12:54 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:12:54 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:12:54 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499
Nov 10 15:12:54 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:12:54 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:12:54 user nova-compute[75703]: FIRMWARE:
Nov 10 15:12:54 user nova-compute[75703]: No targets found.
Nov 10 15:12:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:12:54 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:12:54 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa5cdf-e8b4-421a-89f1-e3828b7804aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce425802-a9fa-4137-b31c-7402600f45dd]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:54 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:54 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:54 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:12:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:12:54 user nova-compute[75703]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f (non-flash)
Nov 10 15:12:54 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:12:54 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:12:54 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a466dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d911d5-0d78-4c14-b91a-a2de2d3bfb17]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f0180-0ed8-44f9-873f-aeb9f137e521]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cf849f-91df-4385-b875-da03f91c7130]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7267e6-0499-4c19-a2c2-0d6f7bdef2d9]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6452ceba-6cf9-446a-b632-1589e53c3e58]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9928f8d7-38b0-400d-941b-d984c06655a7]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260]
Nov 10 15:12:55 user nova-compute[75703]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f, portal: 172.16.0.220,3260] successful.
Nov 10 15:12:55 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a6f45a5-ad34-4808-950d-e35b59f2562f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[477d4461-6d61-4ce6-9396-ad12970c0630]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== disconnect_volume: return (348ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:12:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Deleting instance files /opt/stack/data/nova/instances/75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6_del
Nov 10 15:12:55 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Deletion of /opt/stack/data/nova/instances/75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6_del complete
Nov 10 15:12:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:12:55 user nova-compute[75703]: INFO nova.compute.manager [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:55 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Took 0.43 seconds to deallocate network for instance.
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-f68d2876-0473-4a5a-908e-3a02fe235f34 req-9605a15a-ece6-4540-8660-57920577722d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-vif-deleted-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:55 user nova-compute[75703]: INFO nova.compute.manager [req-f68d2876-0473-4a5a-908e-3a02fe235f34 req-9605a15a-ece6-4540-8660-57920577722d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Neutron deleted interface 314dcba0-671b-447e-849a-3e253f154865; detaching it from the instance and deleting it from the info cache
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-f68d2876-0473-4a5a-908e-3a02fe235f34 req-9605a15a-ece6-4540-8660-57920577722d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-f68d2876-0473-4a5a-908e-3a02fe235f34 req-9605a15a-ece6-4540-8660-57920577722d service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Detach interface failed, port_id=314dcba0-671b-447e-849a-3e253f154865, reason: Instance 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-vif-unplugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] No waiting events found dispatching network-vif-unplugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-vif-unplugged-314dcba0-671b-447e-849a-3e253f154865 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received event network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] Acquiring lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] No waiting events found dispatching network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:12:55 user nova-compute[75703]: WARNING nova.compute.manager [req-46596126-502d-49c8-9908-2899053b86a6 req-9d2efa8a-4f9f-40ac-bff9-d52e8f237a79 service nova] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Received unexpected event network-vif-plugged-314dcba0-671b-447e-849a-3e253f154865 for instance with vm_state active and task_state deleting.
Nov 10 15:12:56 user nova-compute[75703]: INFO nova.compute.manager [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6] Took 1.05 seconds to detach 1 volumes for instance.
Nov 10 15:12:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:12:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:12:56 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:12:56 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:12:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:57 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Deleted allocations for instance 75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6
Nov 10 15:12:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0cbdc94b-e096-41e9-a397-8330e1f7c6ab tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "75b3f8e1-e9aa-4b76-957a-ab0d9d5ec0b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.273s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:12:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:10 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 is timed out.
Nov 10 15:13:10 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config.
Nov 10 15:13:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlEhYUPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:13:10 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e9493-c82a-4fd4-b88d-3929423b2f18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:13:10 user nova-compute[75703]: No targets found.
Nov 10 15:13:10 user nova-compute[75703]: iSNS:
Nov 10 15:13:10 user nova-compute[75703]: No targets found.
Nov 10 15:13:10 user nova-compute[75703]: STATIC:
Nov 10 15:13:10 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7
Nov 10 15:13:10 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:13:10 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:13:10 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:13:10 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:13:10 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:13:10 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499
Nov 10 15:13:10 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:13:10 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:13:10 user nova-compute[75703]: FIRMWARE:
Nov 10 15:13:10 user nova-compute[75703]: No targets found.
Nov 10 15:13:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:13:10 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:13:10 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4d0ae5-519a-413d-aa32-ad6070317832]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c7192b-561d-4849-a23e-e127dc7519bb]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:10 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:13:10 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:10 user nova-compute[75703]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 (non-flash)
Nov 10 15:13:10 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fbe560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499'): ({'sdd'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Removing single pathed devices sdd {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ed1b96-dbc4-4543-a450-1234ddacadd5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[59163742-2e2e-4d63-b5bd-86ced286e01f]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Flushing IO for device /dev/sdd {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9bda8-4c61-4418-891a-c773b1c7e62a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8610f-41a9-4b6c-8cef-0cad26b9f47c]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] SCSI volumes sdd have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c5fe81-9ea3-4499-93f9-c52770f95bac]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a16dec-14f8-4447-9695-ae9330becd4e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260]
Nov 10 15:13:10 user nova-compute[75703]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499, portal: 172.16.0.220,3260] successful.
Nov 10 15:13:10 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5195f214-34e3-474e-bf32-8a5217bf0499 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c16f04-ba6f-465d-947b-58bd2de81503]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== disconnect_volume: return (300ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:13:10 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:13:11 user nova-compute[75703]: DEBUG nova.objects.instance [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:13:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-baee759e-2c3b-4ab7-85ef-c1c7ac43b71b tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.046s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:13:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxsIyAlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:13:17 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:13:17 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:13:17 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a475435f-43dc-423c-82e8-b873185f2b11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:13:17 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cedc6b-4eb4-4aaf-971d-299628ba8555]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e] added
Nov 10 15:13:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499365c-5fe4-4f19-8f04-944cf1d3309b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ba2ef-2164-44d2-9a49-1b2ccc35ec1e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxsIyAlG {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxsIyAlG" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25fb261-e867-4bf9-8406-8635162c56fd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxsIyAlG'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ae2dc-938c-42b0-82e8-ba509ec7e99a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e750380b-b659-418c-a70a-b72d57b3bb56]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0169a1d3-67cf-4f60-b623-293c306ea60b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260]
Nov 10 15:13:17 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260] successful.
Nov 10 15:13:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815df8d-0f01-4c8a-9706-74d08a66657f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2141aaf1-f3ed-468f-9178-f4b989bacef4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e (non-flash)
Nov 10 15:13:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:17 user nova-compute[75703]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e (non-flash)
Nov 10 15:13:17 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d4adf-4059-4fa1-bfe8-3e95c93c2164]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:17 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxsIyAlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26666333865303636', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666333865303636', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'flavor' on Instance uuid e083d89b-6aff-4ca8-9ce9-929ba9236fe5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:13:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:13:18 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:13:18 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:13:18 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:13:18 user nova-compute[75703]:   <serial>1d753fb7-1aab-40cf-969c-8f3491160f1e</serial>
Nov 10 15:13:18 user nova-compute[75703]: </disk>
Nov 10 15:13:18 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] No VIF found with MAC fa:16:3e:c9:9f:30, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8b7e3aa0-dc9e-4fca-955d-51205ffa1802 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.268s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:21 user nova-compute[75703]: INFO nova.compute.manager [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Detaching volume 1d753fb7-1aab-40cf-969c-8f3491160f1e
Nov 10 15:13:21 user nova-compute[75703]: INFO nova.virt.block_device [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Attempting to driver detach volume 1d753fb7-1aab-40cf-969c-8f3491160f1e from mountpoint /dev/vdb
Nov 10 15:13:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Attempting to detach device vdb from instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:13:21 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:13:21 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:13:21 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:13:21 user nova-compute[75703]:   <serial>1d753fb7-1aab-40cf-969c-8f3491160f1e</serial>
Nov 10 15:13:21 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:13:21 user nova-compute[75703]: </disk>
Nov 10 15:13:21 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:13:21 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully detached device vdb from instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 from the persistent domain config.
Nov 10 15:13:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:13:21 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:13:21 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:13:21 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:13:21 user nova-compute[75703]:   <serial>1d753fb7-1aab-40cf-969c-8f3491160f1e</serial>
Nov 10 15:13:21 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:13:21 user nova-compute[75703]: </disk>
Nov 10 15:13:21 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:13:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:13:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=24.794666290283203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b161728d-6d17-43a4-9663-37d7727f3b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d036404a-0828-40c3-afb4-b29ada8c5c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 9ac582d7-0457-4b97-8d71-837ceb19864d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:23 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:13:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:13:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:13:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:13:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 5 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:13:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:13:42 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 is timed out.
Nov 10 15:13:42 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully detached device vdb from instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 from the live domain config.
Nov 10 15:13:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxsIyAlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:13:42 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15a5ab-0ce5-4d86-88c3-c1f4277088f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:13:42 user nova-compute[75703]: No targets found.
Nov 10 15:13:42 user nova-compute[75703]: iSNS:
Nov 10 15:13:42 user nova-compute[75703]: No targets found.
Nov 10 15:13:42 user nova-compute[75703]: STATIC:
Nov 10 15:13:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7
Nov 10 15:13:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:13:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:13:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e
Nov 10 15:13:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:13:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:13:42 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:13:42 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:13:42 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:13:42 user nova-compute[75703]: FIRMWARE:
Nov 10 15:13:42 user nova-compute[75703]: No targets found.
Nov 10 15:13:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:13:42 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:13:42 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c462a3-4305-4688-b2f1-081873d7dd8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563ff46-e773-4fb6-9e2e-f12df76c5178]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:42 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:42 user nova-compute[75703]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e (non-flash)
Nov 10 15:13:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:13:42 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:13:42 user nova-compute[75703]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e (non-flash)
Nov 10 15:13:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4c4303250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[439efeff-93b8-493e-b162-43e52617e832]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac117b1-238a-41dc-8b0e-bcd8fc827789]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd6085-ea8b-4ca9-812d-3d940ce16c4f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dcdf5a-5239-4adf-a678-bf506dc7b86b]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d45274b-a75a-498b-97aa-25cd8019b42c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[82172ccc-a182-4601-8351-8f21ee7eb395]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260]
Nov 10 15:13:42 user nova-compute[75703]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e, portal: 172.16.0.220,3260] successful.
Nov 10 15:13:42 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d753fb7-1aab-40cf-969c-8f3491160f1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c5236-aa80-4de5-8257-1c4dbaa512dc]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] <== disconnect_volume: return (329ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:13:42 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:13:43 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'flavor' on Instance uuid e083d89b-6aff-4ca8-9ce9-929ba9236fe5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:13:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d309aa68-a4a9-437f-8961-b8d3b028b4c3 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.148s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:45 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:13:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:46 user nova-compute[75703]: INFO nova.compute.manager [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attaching volume c97bbcdf-5e45-4fa3-a6e5-75803e08f490 to /dev/vdb
Nov 10 15:13:46 user nova-compute[75703]: DEBUG os_brick.utils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff765fb7-1a66-47c7-a455-f653074b015a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[93258052-569a-4599-8817-66cfe1009edd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e04fad-ef50-4e82-8fba-ce418d090495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c95390a-72b5-4631-b13a-58c59a3989fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:13:46 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:13:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f85983-31f1-4bdf-af56-b365b070d9ab]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG os_brick.utils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:13:46 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating existing volume attachment record: b9119400-47a8-4f96-90cd-9714a3bde997 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:13:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:13:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-changed-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:13:58 user nova-compute[75703]: DEBUG nova.compute.manager [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Refreshing instance network info cache due to event network-changed-983f79b0-3ca8-4c61-8da1-40873962657d. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:13:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] Acquiring lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:13:58 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] Acquired lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:13:58 user nova-compute[75703]: DEBUG nova.network.neutron [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Refreshing network info cache for port 983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.network.neutron [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Updated VIF entry in instance network info cache for port 983f79b0-3ca8-4c61-8da1-40873962657d. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.network.neutron [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Updating instance_info_cache with network_info: [{"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-4a342348-caa9-4457-a69a-852e1b734b03 req-44cd6ccf-9436-4abd-8249-844c54a82e0c service nova] Releasing lock "refresh_cache-9ac582d7-0457-4b97-8d71-837ceb19864d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:13:59 user nova-compute[75703]: INFO nova.compute.manager [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Terminating instance
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-a9df3793-a3f6-4522-804d-0a3c77e5de23 req-3334a2bb-f8c4-41e5-b087-50b8f9d33b46 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-vif-unplugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a9df3793-a3f6-4522-804d-0a3c77e5de23 req-3334a2bb-f8c4-41e5-b087-50b8f9d33b46 service nova] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a9df3793-a3f6-4522-804d-0a3c77e5de23 req-3334a2bb-f8c4-41e5-b087-50b8f9d33b46 service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a9df3793-a3f6-4522-804d-0a3c77e5de23 req-3334a2bb-f8c4-41e5-b087-50b8f9d33b46 service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-a9df3793-a3f6-4522-804d-0a3c77e5de23 req-3334a2bb-f8c4-41e5-b087-50b8f9d33b46 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] No waiting events found dispatching network-vif-unplugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-a9df3793-a3f6-4522-804d-0a3c77e5de23 req-3334a2bb-f8c4-41e5-b087-50b8f9d33b46 service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-vif-unplugged-983f79b0-3ca8-4c61-8da1-40873962657d for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Instance destroyed successfully.
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.objects.instance [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'resources' on Instance uuid 9ac582d7-0457-4b97-8d71-837ceb19864d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1956354809',display_name='tempest-AttachVolumeNegativeTest-server-1956354809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1956354809',id=48,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7N+zvqrmWPkK3tmj6fVwl+b4gjnlf6da+R5HlhOKCfg/bQkHIhwgrjOLkXh1Eh48yJD3cFvl6IRUJsuWhRTe51VTmuOzdyUsSk2a3PoXBlYXmX3zWhqkEUGERAr/RqmA==',key_name='tempest-keypair-2115889348',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-0vo4ols7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=9ac582d7-0457-4b97-8d71-837ceb19864d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "983f79b0-3ca8-4c61-8da1-40873962657d", "address": "fa:16:3e:a4:c5:d4", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983f79b0-3c", "ovs_interfaceid": "983f79b0-3ca8-4c61-8da1-40873962657d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG os_vif [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap983f79b0-3c, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88f51532-6b92-4ca7-9833-b195685d9877) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:13:59 user nova-compute[75703]: INFO os_vif [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:d4,bridge_name='br-int',has_traffic_filtering=True,id=983f79b0-3ca8-4c61-8da1-40873962657d,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983f79b0-3c')
Nov 10 15:13:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Deleting instance files /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d_del
Nov 10 15:13:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Deletion of /opt/stack/data/nova/instances/9ac582d7-0457-4b97-8d71-837ceb19864d_del complete
Nov 10 15:13:59 user nova-compute[75703]: INFO nova.compute.manager [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 10 15:13:59 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:13:59 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:14:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:00 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:00 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Took 0.87 seconds to deallocate network for instance.
Nov 10 15:14:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:00 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:01 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Deleted allocations for instance 9ac582d7-0457-4b97-8d71-837ceb19864d
Nov 10 15:14:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-29c5ac1c-2099-4a79-8ce6-6b675ba65deb tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.303s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] Acquiring lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] Lock "9ac582d7-0457-4b97-8d71-837ceb19864d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] No waiting events found dispatching network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:01 user nova-compute[75703]: WARNING nova.compute.manager [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received unexpected event network-vif-plugged-983f79b0-3ca8-4c61-8da1-40873962657d for instance with vm_state deleted and task_state None.
Nov 10 15:14:01 user nova-compute[75703]: DEBUG nova.compute.manager [req-b7e54539-917c-4d03-a9a4-0788d7646db7 req-ccc417ea-ec27-4d87-96ec-7ea1e914f34f service nova] [instance: 9ac582d7-0457-4b97-8d71-837ceb19864d] Received event network-vif-deleted-983f79b0-3ca8-4c61-8da1-40873962657d {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-changed-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Refreshing instance network info cache due to event network-changed-fa4231eb-75f4-4b08-81c4-58e77b263859. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] Acquiring lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] Acquired lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Refreshing network info cache for port fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:08 user nova-compute[75703]: INFO nova.compute.manager [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Terminating instance
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.compute.manager [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b868223-d380-4216-80b5-48aa2d9e3a22 req-c2b02fea-d583-4bc0-aaf9-091697f1f71e service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-vif-unplugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b868223-d380-4216-80b5-48aa2d9e3a22 req-c2b02fea-d583-4bc0-aaf9-091697f1f71e service nova] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b868223-d380-4216-80b5-48aa2d9e3a22 req-c2b02fea-d583-4bc0-aaf9-091697f1f71e service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7b868223-d380-4216-80b5-48aa2d9e3a22 req-c2b02fea-d583-4bc0-aaf9-091697f1f71e service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b868223-d380-4216-80b5-48aa2d9e3a22 req-c2b02fea-d583-4bc0-aaf9-091697f1f71e service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] No waiting events found dispatching network-vif-unplugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-7b868223-d380-4216-80b5-48aa2d9e3a22 req-c2b02fea-d583-4bc0-aaf9-091697f1f71e service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-vif-unplugged-fa4231eb-75f4-4b08-81c4-58e77b263859 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updated VIF entry in instance network info cache for port fa4231eb-75f4-4b08-81c4-58e77b263859. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.network.neutron [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating instance_info_cache with network_info: [{"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-84005d63-acac-4897-92af-c776334ab15b req-556d4277-74c8-459c-b675-ac9767a7a130 service nova] Releasing lock "refresh_cache-b161728d-6d17-43a4-9663-37d7727f3b6b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:14:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Instance destroyed successfully.
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.objects.instance [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lazy-loading 'resources' on Instance uuid b161728d-6d17-43a4-9663-37d7727f3b6b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1844074232',display_name='tempest-TestVolumeBootPattern-server-1844074232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1844074232',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+lJHX2kCl2mmf8UHkQD2/tSZXYLYqda/aSfr7l1/yXaCY12kpG/9X1DU8HPgUCF0MnQ3hvSHWOYURyVaGTIglRO0C8i5MZhZyZR3wUDTP1p9u8d12zzRU15v7AQe5eng==',key_name='tempest-TestVolumeBootPattern-550353560',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c013cf84f8b414ba6d2d888ddc2ee1b',ramdisk_id='',reservation_id='r-ag4y96zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-982390102',owner_user_name='tempest-TestVolumeBootPattern-982390102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:09:35Z,user_data=None,user_id='67a5a4845f164d8cba0951d82f2430e9',uuid=b161728d-6d17-43a4-9663-37d7727f3b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converting VIF {"id": "fa4231eb-75f4-4b08-81c4-58e77b263859", "address": "fa:16:3e:81:75:b5", "network": {"id": "dc3264c8-bf56-45cc-a721-b1ec5d7f55ce", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1316343782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c013cf84f8b414ba6d2d888ddc2ee1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4231eb-75", "ovs_interfaceid": "fa4231eb-75f4-4b08-81c4-58e77b263859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_vif [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4231eb-75, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79187dcf-f550-45ac-9a15-bc15d155cb47) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:09 user nova-compute[75703]: INFO os_vif [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:75:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa4231eb-75f4-4b08-81c4-58e77b263859,network=Network(dc3264c8-bf56-45cc-a721-b1ec5d7f55ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4231eb-75')
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGsQLlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:14:09 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[525dd322-3c4c-45b0-b029-dfa2d1777d40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:14:09 user nova-compute[75703]: No targets found.
Nov 10 15:14:09 user nova-compute[75703]: iSNS:
Nov 10 15:14:09 user nova-compute[75703]: No targets found.
Nov 10 15:14:09 user nova-compute[75703]: STATIC:
Nov 10 15:14:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7
Nov 10 15:14:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:14:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:14:09 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:14:09 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:14:09 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:14:09 user nova-compute[75703]: FIRMWARE:
Nov 10 15:14:09 user nova-compute[75703]: No targets found.
Nov 10 15:14:09 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:14:09 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:14:09 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed19f68-0d39-4353-aac5-0ff8907ac569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff226848-bf46-4efb-a78a-c3a8a452d27d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:14:09 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:09 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 (non-flash)
Nov 10 15:14:09 user nova-compute[75703]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:09 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a4789e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7'): ({'sdc'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Removing single pathed devices sdc {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747454f-6455-4b76-acaa-ae98c696eec8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba5dc6d-70ac-440e-b50d-1b1049302aef]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Flushing IO for device /dev/sdc {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca5398a-2554-4cdb-ad44-38a44e16ce07]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf12b3d-59d7-4a57-bec9-5a6ba30efb71]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] SCSI volumes sdc have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO309e642b-8ab8dd30b0e8a4a4', '/dev/disk/by-id/scsi-23861623864643330', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_309e642b') {{(pid=87268) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057315b-8644-4331-9306-a18afc6e9e48]: (4, None) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdc4d34-089a-4f83-bb53-100ceced5b07]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269d3c0-04f0-4cfb-8254-d058b0edf132]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260]
Nov 10 15:14:09 user nova-compute[75703]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7, portal: 172.16.0.220,3260] successful.
Nov 10 15:14:09 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0779f06-151c-4e63-8364-417c1d24fbf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[594cf282-e363-4eab-a514-c9112ba9870e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] <== disconnect_volume: return (332ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:14:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Deleting instance files /opt/stack/data/nova/instances/b161728d-6d17-43a4-9663-37d7727f3b6b_del
Nov 10 15:14:09 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Deletion of /opt/stack/data/nova/instances/b161728d-6d17-43a4-9663-37d7727f3b6b_del complete
Nov 10 15:14:09 user nova-compute[75703]: INFO nova.compute.manager [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 10 15:14:09 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:14:09 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:14:10 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:10 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Took 0.46 seconds to deallocate network for instance.
Nov 10 15:14:10 user nova-compute[75703]: DEBUG nova.compute.manager [req-04b20935-838c-490e-ab5a-61d6edc3d8fd req-824bcf42-bfcc-4266-ae1a-6ce125bd8fda service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-vif-deleted-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPHECgSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:14:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:14:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:14:11 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6c663-fd41-462e-ab44-bcc05003241a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:14:11 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-666dc986-a1c2-40ac-be54-cfef14d0f7a0 req-74fdd7c1-a615-4b6f-8039-ba1913092b80 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received event network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-666dc986-a1c2-40ac-be54-cfef14d0f7a0 req-74fdd7c1-a615-4b6f-8039-ba1913092b80 service nova] Acquiring lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-666dc986-a1c2-40ac-be54-cfef14d0f7a0 req-74fdd7c1-a615-4b6f-8039-ba1913092b80 service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-666dc986-a1c2-40ac-be54-cfef14d0f7a0 req-74fdd7c1-a615-4b6f-8039-ba1913092b80 service nova] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-666dc986-a1c2-40ac-be54-cfef14d0f7a0 req-74fdd7c1-a615-4b6f-8039-ba1913092b80 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] No waiting events found dispatching network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:11 user nova-compute[75703]: WARNING nova.compute.manager [req-666dc986-a1c2-40ac-be54-cfef14d0f7a0 req-74fdd7c1-a615-4b6f-8039-ba1913092b80 service nova] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Received unexpected event network-vif-plugged-fa4231eb-75f4-4b08-81c4-58e77b263859 for instance with vm_state active and task_state deleting.
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3a255-4bb3-4f3f-9523-df13d43be272]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490] added
Nov 10 15:14:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05ea8f-8553-417a-848a-7ca5976cecc5]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f89060-32eb-4871-b68c-f565d4ab81c4]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPHECgSZ {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPHECgSZ" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7222ae4-8d0d-431b-90a8-95fd46c96c26]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPHECgSZ'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3715b-3495-4fa6-9529-5b88eabb1bc4]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7296cd78-b8a1-4531-9980-e23090eaadea]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: INFO nova.compute.manager [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] [instance: b161728d-6d17-43a4-9663-37d7727f3b6b] Took 0.94 seconds to detach 1 volumes for instance.
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a1e4e-2f7a-4856-8bb7-12c4564ec7ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260]
Nov 10 15:14:11 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260] successful.
Nov 10 15:14:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8777c76-5f97-4488-afcc-651ad74f15cc]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1339f72-52b8-4955-b576-978fa1a4250f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:11 user nova-compute[75703]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 (non-flash)
Nov 10 15:14:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:11 user nova-compute[75703]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 (non-flash)
Nov 10 15:14:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9da322-bfc0-4529-89fa-ca7b3e280486]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:11 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Deleted allocations for instance b161728d-6d17-43a4-9663-37d7727f3b6b
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-04292bb5-fa39-4ce0-bb36-882936370a09 tempest-TestVolumeBootPattern-982390102 tempest-TestVolumeBootPattern-982390102-project-member] Lock "b161728d-6d17-43a4-9663-37d7727f3b6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-changed-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.compute.manager [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Refreshing instance network info cache due to event network-changed-c7f0c11a-bc34-48b5-85f8-d4026282ae25. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] Acquiring lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] Acquired lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:14:11 user nova-compute[75703]: DEBUG nova.network.neutron [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Refreshing network info cache for port c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:12 user nova-compute[75703]: INFO nova.compute.manager [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Terminating instance
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.compute.manager [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPHECgSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23632366463323464', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632366463323464', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:14:12 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:14:12 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:14:12 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:14:12 user nova-compute[75703]:   <serial>c97bbcdf-5e45-4fa3-a6e5-75803e08f490</serial>
Nov 10 15:14:12 user nova-compute[75703]: </disk>
Nov 10 15:14:12 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updated VIF entry in instance network info cache for port c7f0c11a-bc34-48b5-85f8-d4026282ae25. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.network.neutron [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating instance_info_cache with network_info: [{"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0e27911e-af46-4d19-99b9-ae16c0f7f7c9 req-aaf9ab64-619e-4c44-8d4c-95a4d94f414d service nova] Releasing lock "refresh_cache-e083d89b-6aff-4ca8-9ce9-929ba9236fe5" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No VIF found with MAC fa:16:3e:68:8d:e6, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:14:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-6539aaf9-7c9c-4b7a-bbd7-0caf2193e2dd tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.773s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Instance destroyed successfully.
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.objects.instance [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'resources' on Instance uuid e083d89b-6aff-4ca8-9ce9-929ba9236fe5 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1999150527',display_name='tempest-TestStampPattern-server-1999150527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1999150527',id=46,image_ref='d8668dee-ca5a-48c0-b6de-20fabe803f7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnBXfBlOXi2aS+QsQoo4WrpyvXZk+kDG3vQXqkaS4Sck7gWlnx2z2npznqQCZiwOuw3oc2sro6uqziSWJxc6dsLg3QQ16Ey8DOQXS+LIVfU5uH0OsAz1r4O0pGf39XV3w==',key_name='tempest-TestStampPattern-32336318',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9763add2a3741d1a75370ee532cc2a3',ramdisk_id='',reservation_id='r-epe7k8vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b84f952d-98ef-41c8-b2e1-313a5b553544',image_min_disk='1',image_min_ram='0',image_owner_id='c9763add2a3741d1a75370ee532cc2a3',image_owner_project_name='tempest-TestStampPattern-1606130469',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1606130469-project-member',image_user_id='23d189e700bd40ed8ee23d74de3a0681',owner_project_name='tempest-TestStampPattern-1606130469',owner_user_name='tempest-TestStampPattern-1606130469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:10:56Z,user_data=None,user_id='23d189e700bd40ed8ee23d74de3a0681',uuid=e083d89b-6aff-4ca8-9ce9-929ba9236fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converting VIF {"id": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "address": "fa:16:3e:c9:9f:30", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f0c11a-bc", "ovs_interfaceid": "c7f0c11a-bc34-48b5-85f8-d4026282ae25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG os_vif [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f0c11a-bc, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06d78292-59db-4e03-8e3b-02d1fc17c964) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:13 user nova-compute[75703]: INFO os_vif [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9f:30,bridge_name='br-int',has_traffic_filtering=True,id=c7f0c11a-bc34-48b5-85f8-d4026282ae25,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f0c11a-bc')
Nov 10 15:14:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Deleting instance files /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5_del
Nov 10 15:14:13 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Deletion of /opt/stack/data/nova/instances/e083d89b-6aff-4ca8-9ce9-929ba9236fe5_del complete
Nov 10 15:14:13 user nova-compute[75703]: INFO nova.compute.manager [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 10 15:14:13 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-6cc020a8-cc2d-49bb-b970-37e4bc67fd39 req-c918cb2f-76cb-498c-9f60-8eaaf5114b82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-deleted-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:13 user nova-compute[75703]: INFO nova.compute.manager [req-6cc020a8-cc2d-49bb-b970-37e4bc67fd39 req-c918cb2f-76cb-498c-9f60-8eaaf5114b82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Neutron deleted interface c7f0c11a-bc34-48b5-85f8-d4026282ae25; detaching it from the instance and deleting it from the info cache
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-6cc020a8-cc2d-49bb-b970-37e4bc67fd39 req-c918cb2f-76cb-498c-9f60-8eaaf5114b82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:13 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Took 0.67 seconds to deallocate network for instance.
Nov 10 15:14:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-6cc020a8-cc2d-49bb-b970-37e4bc67fd39 req-c918cb2f-76cb-498c-9f60-8eaaf5114b82 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Detach interface failed, port_id=c7f0c11a-bc34-48b5-85f8-d4026282ae25, reason: Instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-unplugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-unplugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:14 user nova-compute[75703]: WARNING nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-unplugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state deleted and task_state None.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:14 user nova-compute[75703]: WARNING nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state deleted and task_state None.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:14 user nova-compute[75703]: WARNING nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state deleted and task_state None.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:14 user nova-compute[75703]: WARNING nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state deleted and task_state None.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-unplugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-unplugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:14 user nova-compute[75703]: WARNING nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-unplugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state deleted and task_state None.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Acquiring lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] No waiting events found dispatching network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:14:14 user nova-compute[75703]: WARNING nova.compute.manager [req-6a70c5e5-2de2-4829-9c7f-4ce6fa291106 req-a13f78a1-7eb1-4115-8ecc-ea9a20f5c995 service nova] [instance: e083d89b-6aff-4ca8-9ce9-929ba9236fe5] Received unexpected event network-vif-plugged-c7f0c11a-bc34-48b5-85f8-d4026282ae25 for instance with vm_state deleted and task_state None.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Deleted allocations for instance e083d89b-6aff-4ca8-9ce9-929ba9236fe5
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-9c3d4b82-a82d-4d80-a038-ea6dc60e1cf8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "e083d89b-6aff-4ca8-9ce9-929ba9236fe5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:14 user nova-compute[75703]: INFO nova.compute.manager [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Detaching volume c97bbcdf-5e45-4fa3-a6e5-75803e08f490
Nov 10 15:14:14 user nova-compute[75703]: INFO nova.virt.block_device [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attempting to driver detach volume c97bbcdf-5e45-4fa3-a6e5-75803e08f490 from mountpoint /dev/vdb
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Attempting to detach device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:14:14 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:14:14 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:14:14 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:14:14 user nova-compute[75703]:   <serial>c97bbcdf-5e45-4fa3-a6e5-75803e08f490</serial>
Nov 10 15:14:14 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:14:14 user nova-compute[75703]: </disk>
Nov 10 15:14:14 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:14:14 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config.
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:14:14 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:14:14 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:14:14 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:14:14 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:14:14 user nova-compute[75703]:   <serial>c97bbcdf-5e45-4fa3-a6e5-75803e08f490</serial>
Nov 10 15:14:14 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:14:14 user nova-compute[75703]: </disk>
Nov 10 15:14:14 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:14:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:15 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:14:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:18 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:18 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:14:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:14:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:14:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating instance_info_cache with network_info: [{"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-d036404a-0828-40c3-afb4-b29ada8c5c4b" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:19 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:14:20 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:14:20 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:14:20 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=24.820411682128906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d036404a-0828-40c3-afb4-b29ada8c5c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:14:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:14:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:14:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:14:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:35 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 is timed out.
Nov 10 15:14:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config.
Nov 10 15:14:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPHECgSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:14:35 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[de810e68-bf06-4ac9-a968-27b7e5de8a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:14:35 user nova-compute[75703]: No targets found.
Nov 10 15:14:35 user nova-compute[75703]: iSNS:
Nov 10 15:14:35 user nova-compute[75703]: No targets found.
Nov 10 15:14:35 user nova-compute[75703]: STATIC:
Nov 10 15:14:35 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:14:35 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:14:35 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:14:35 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490
Nov 10 15:14:35 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:14:35 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:14:35 user nova-compute[75703]: FIRMWARE:
Nov 10 15:14:35 user nova-compute[75703]: No targets found.
Nov 10 15:14:35 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:14:35 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:14:35 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[818f0c27-122c-42d6-8377-471891373ced]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd5481d-5518-4cb9-be54-d886b5b3939c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:35 user nova-compute[75703]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 (non-flash)
Nov 10 15:14:35 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:14:35 user nova-compute[75703]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 (non-flash)
Nov 10 15:14:35 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a41b1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb34ce-183a-4fe5-a1ad-e293d38e632e]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af421f43-08d5-494a-a2e4-f53f20ebae1b]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9958298-a3e6-4df4-be63-a8ac88274787]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c590c-834b-478c-82f8-414aa75fcbdd]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c37a263-53c9-4372-ba93-50e98443fca8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdac8cb4-d5fb-468c-9b44-16df489abecf]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260]
Nov 10 15:14:35 user nova-compute[75703]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490, portal: 172.16.0.220,3260] successful.
Nov 10 15:14:35 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97bbcdf-5e45-4fa3-a6e5-75803e08f490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[28956825-1d9e-4d36-86aa-97932467c655]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== disconnect_volume: return (263ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:14:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:14:36 user nova-compute[75703]: DEBUG nova.objects.instance [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:14:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-be36d853-02cc-4943-8130-82e3d6940686 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.943s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:14:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:14:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:14:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:14:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:14:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:14:50 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:14:50 user nova-compute[75703]: INFO nova.compute.manager [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Detaching volume 58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:14:50 user nova-compute[75703]: INFO nova.virt.block_device [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Attempting to driver detach volume 58987b59-b9f8-4493-b4a9-72bef5a25c07 from mountpoint /dev/vdb
Nov 10 15:14:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Attempting to detach device vdb from instance d036404a-0828-40c3-afb4-b29ada8c5c4b from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:14:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:14:50 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:14:50 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 15:14:50 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:14:50 user nova-compute[75703]:   <serial>58987b59-b9f8-4493-b4a9-72bef5a25c07</serial>
Nov 10 15:14:50 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:14:50 user nova-compute[75703]: </disk>
Nov 10 15:14:50 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:14:50 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully detached device vdb from instance d036404a-0828-40c3-afb4-b29ada8c5c4b from the persistent domain config.
Nov 10 15:14:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d036404a-0828-40c3-afb4-b29ada8c5c4b from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:14:50 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:14:50 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:14:50 user nova-compute[75703]:   <source dev="/dev/sde"/>
Nov 10 15:14:50 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:14:50 user nova-compute[75703]:   <serial>58987b59-b9f8-4493-b4a9-72bef5a25c07</serial>
Nov 10 15:14:50 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:14:50 user nova-compute[75703]: </disk>
Nov 10 15:14:50 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:14:51 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:14:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:14:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:15:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:15:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:11 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d036404a-0828-40c3-afb4-b29ada8c5c4b is timed out.
Nov 10 15:15:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully detached device vdb from instance d036404a-0828-40c3-afb4-b29ada8c5c4b from the live domain config.
Nov 10 15:15:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufWloUpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:15:11 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d82919-16d8-4e17-9cb6-8d3ab28d29ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:15:11 user nova-compute[75703]: No targets found.
Nov 10 15:15:11 user nova-compute[75703]: iSNS:
Nov 10 15:15:11 user nova-compute[75703]: No targets found.
Nov 10 15:15:11 user nova-compute[75703]: STATIC:
Nov 10 15:15:11 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07
Nov 10 15:15:11 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:15:11 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:15:11 user nova-compute[75703]: FIRMWARE:
Nov 10 15:15:11 user nova-compute[75703]: No targets found.
Nov 10 15:15:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:15:11 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:15:11 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1dfb25-6be8-44a3-8d9b-d757d31f40e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f00561c-18c7-4c03-9571-0c406b975c0a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:15:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 (non-flash)
Nov 10 15:15:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fbfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07'): ({'sde'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Removing single pathed devices sde {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e227175-9ac1-4beb-b18d-23beadb4ab86]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f168e5-44d0-49ab-beaa-3b32f3f7c44b]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flushing IO for device /dev/sde {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc0775b-bbaf-4499-adad-239433c49736]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e879ae1f-52b8-49fd-8bf3-1661b208f63f]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] SCSI volumes sde have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b06dd3-b9fb-46b8-8f71-468da9aacc31]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba48fb7e-6c02-46ab-8b69-c22aaa04f77f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260]
Nov 10 15:15:11 user nova-compute[75703]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07, portal: 172.16.0.220,3260] successful.
Nov 10 15:15:11 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58987b59-b9f8-4493-b4a9-72bef5a25c07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a45c465-0583-4b6d-8eb3-c0cbf9d1ddf8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== disconnect_volume: return (329ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:15:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:12 user nova-compute[75703]: INFO nova.compute.manager [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attaching volume ccdd057a-175b-4d6d-9c6c-b88211441c08 to /dev/vdb
Nov 10 15:15:12 user nova-compute[75703]: DEBUG os_brick.utils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31d8b1-ecb0-4dc3-ac94-ceaa71a87b89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9913661-1b30-4033-b423-37c48f729572]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcaa429-5ee1-4a5d-ace9-3d5c4d4df917]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b9d459-1a18-445f-a5dc-3b07d5393910]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:15:12 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda08452-fb2d-43b7-a9b6-b2942f85987e]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG os_brick.utils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating existing volume attachment record: 7a066ce7-688d-41c5-8b1d-ab3ba9921b66 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:15:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1e71a516-dc11-4b36-8ec5-581b74556fed tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.039s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:15:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:15:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:15:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=24.916065216064453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance b84f952d-98ef-41c8-b2e1-313a5b553544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance d036404a-0828-40c3-afb4-b29ada8c5c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:15:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:28 user nova-compute[75703]: INFO nova.compute.manager [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Terminating instance
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.compute.manager [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-changed-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.compute.manager [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Refreshing instance network info cache due to event network-changed-4056844c-0fcf-4a39-a6d1-c6327a9d640e. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] Acquiring lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] Acquired lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Refreshing network info cache for port 4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updated VIF entry in instance network info cache for port 4056844c-0fcf-4a39-a6d1-c6327a9d640e. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.network.neutron [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [{"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-cd7b837b-aa53-48b9-8db0-749d7025d418 req-96834a8b-9959-4dd7-aaf0-a88e257469a8 service nova] Releasing lock "refresh_cache-b84f952d-98ef-41c8-b2e1-313a5b553544" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:15:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Instance destroyed successfully.
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.objects.instance [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lazy-loading 'resources' on Instance uuid b84f952d-98ef-41c8-b2e1-313a5b553544 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1224786784',display_name='tempest-TestStampPattern-server-1224786784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1224786784',id=42,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnBXfBlOXi2aS+QsQoo4WrpyvXZk+kDG3vQXqkaS4Sck7gWlnx2z2npznqQCZiwOuw3oc2sro6uqziSWJxc6dsLg3QQ16Ey8DOQXS+LIVfU5uH0OsAz1r4O0pGf39XV3w==',key_name='tempest-TestStampPattern-32336318',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:06:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9763add2a3741d1a75370ee532cc2a3',ramdisk_id='',reservation_id='r-aaated74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1606130469',owner_user_name='tempest-TestStampPattern-1606130469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:10:45Z,user_data=None,user_id='23d189e700bd40ed8ee23d74de3a0681',uuid=b84f952d-98ef-41c8-b2e1-313a5b553544,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converting VIF {"id": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "address": "fa:16:3e:6b:35:93", "network": {"id": "e7f505c7-5168-45ad-8239-259457cda3de", "bridge": "br-int", "label": "tempest-TestStampPattern-915819042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9763add2a3741d1a75370ee532cc2a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4056844c-0f", "ovs_interfaceid": "4056844c-0fcf-4a39-a6d1-c6327a9d640e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG os_vif [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4056844c-0f, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab3ba0dd-ce4e-4dce-b7a5-6cf61ee2d568) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:28 user nova-compute[75703]: INFO os_vif [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:35:93,bridge_name='br-int',has_traffic_filtering=True,id=4056844c-0fcf-4a39-a6d1-c6327a9d640e,network=Network(e7f505c7-5168-45ad-8239-259457cda3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4056844c-0f')
Nov 10 15:15:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Deleting instance files /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544_del
Nov 10 15:15:28 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Deletion of /opt/stack/data/nova/instances/b84f952d-98ef-41c8-b2e1-313a5b553544_del complete
Nov 10 15:15:28 user nova-compute[75703]: INFO nova.compute.manager [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 15:15:28 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:15:28 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:15:29 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:15:29 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Took 0.44 seconds to deallocate network for instance.
Nov 10 15:15:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:29 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:15:29 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:15:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:29 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Deleted allocations for instance b84f952d-98ef-41c8-b2e1-313a5b553544
Nov 10 15:15:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-4a13b906-0c7e-46dc-8b65-5d1c2675d1f8 tempest-TestStampPattern-1606130469 tempest-TestStampPattern-1606130469-project-member] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.632s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-vif-unplugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] No waiting events found dispatching network-vif-unplugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:15:30 user nova-compute[75703]: WARNING nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received unexpected event network-vif-unplugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e for instance with vm_state deleted and task_state None.
Nov 10 15:15:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] Acquiring lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] Lock "b84f952d-98ef-41c8-b2e1-313a5b553544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] No waiting events found dispatching network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:15:30 user nova-compute[75703]: WARNING nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received unexpected event network-vif-plugged-4056844c-0fcf-4a39-a6d1-c6327a9d640e for instance with vm_state deleted and task_state None.
Nov 10 15:15:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-532b6279-f755-43bb-8ea5-719f10653236 req-7eca38aa-785b-43ba-b01c-bd783a8b2b36 service nova] [instance: b84f952d-98ef-41c8-b2e1-313a5b553544] Received event network-vif-deleted-4056844c-0fcf-4a39-a6d1-c6327a9d640e {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:15:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQxlrtaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:15:35 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:15:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:15:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:15:35 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:15:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:15:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:15:35 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:15:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03cce06-dd95-494b-84c7-632a69c5cbc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:15:36 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f511d1-057e-4d26-a170-6aeca3165daa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08] added
Nov 10 15:15:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e5430c-b9a9-4996-99e0-c6b11f5addfd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef8965f-fc56-496e-985d-c3c7a07272a4]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQxlrtaw {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQxlrtaw" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66461e55-8764-4e6d-95bc-45f289514d44]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQxlrtaw'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b90d9c-747f-4b54-a66e-bb967f7bcc7a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafced6a-bcad-42af-82e3-f4a66d8bb1aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:15:36 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:15:36 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:15:36 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:15:36 user nova-compute[75703]: 
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3992e916-9f90-4109-93e5-51a89094d73d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260]
Nov 10 15:15:36 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260] successful.
Nov 10 15:15:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0307f2b-a944-47bf-bd4f-b7f256716f3c]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d22798-1d13-42cb-8cd1-30bbc552ee46]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 (non-flash)
Nov 10 15:15:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 (non-flash)
Nov 10 15:15:36 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[679aa592-471a-405f-8bd5-530e3fa8d51f]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:15:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQxlrtaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23865666536613430', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865666536613430', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:15:37 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:15:37 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:15:37 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:15:37 user nova-compute[75703]:   <serial>ccdd057a-175b-4d6d-9c6c-b88211441c08</serial>
Nov 10 15:15:37 user nova-compute[75703]: </disk>
Nov 10 15:15:37 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No VIF found with MAC fa:16:3e:68:8d:e6, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:15:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-cc7f0cb6-aade-42e3-99bc-b65330ccb9c0 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.445s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:15:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:39 user nova-compute[75703]: INFO nova.compute.manager [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Detaching volume ccdd057a-175b-4d6d-9c6c-b88211441c08
Nov 10 15:15:39 user nova-compute[75703]: INFO nova.virt.block_device [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attempting to driver detach volume ccdd057a-175b-4d6d-9c6c-b88211441c08 from mountpoint /dev/vdb
Nov 10 15:15:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Attempting to detach device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:15:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:15:39 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:15:39 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:15:39 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:15:39 user nova-compute[75703]:   <serial>ccdd057a-175b-4d6d-9c6c-b88211441c08</serial>
Nov 10 15:15:39 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:15:39 user nova-compute[75703]: </disk>
Nov 10 15:15:39 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:15:39 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config.
Nov 10 15:15:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:15:39 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:15:39 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:15:39 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:15:39 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:15:39 user nova-compute[75703]:   <serial>ccdd057a-175b-4d6d-9c6c-b88211441c08</serial>
Nov 10 15:15:39 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:15:39 user nova-compute[75703]: </disk>
Nov 10 15:15:39 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:40 user nova-compute[75703]: INFO nova.compute.manager [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Terminating instance
Nov 10 15:15:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff7da422-5949-4a26-9001-5785a618e5ce req-2bb826f4-4f01-4e9c-b85f-5661b37a23db service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-vif-unplugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff7da422-5949-4a26-9001-5785a618e5ce req-2bb826f4-4f01-4e9c-b85f-5661b37a23db service nova] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff7da422-5949-4a26-9001-5785a618e5ce req-2bb826f4-4f01-4e9c-b85f-5661b37a23db service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ff7da422-5949-4a26-9001-5785a618e5ce req-2bb826f4-4f01-4e9c-b85f-5661b37a23db service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff7da422-5949-4a26-9001-5785a618e5ce req-2bb826f4-4f01-4e9c-b85f-5661b37a23db service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] No waiting events found dispatching network-vif-unplugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-ff7da422-5949-4a26-9001-5785a618e5ce req-2bb826f4-4f01-4e9c-b85f-5661b37a23db service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-vif-unplugged-69e4a57b-d706-4230-8f71-faad4ffef57a for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:15:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Instance destroyed successfully.
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'resources' on Instance uuid d036404a-0828-40c3-afb4-b29ada8c5c4b {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-5195052',display_name='tempest-AttachVolumeNegativeTest-server-5195052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-5195052',id=45,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGb+dKwLo+/O1OY1t3HAoENGdaZLRMab2FiGkTykh3Tyg4bMkI87SBD3HoanUa4PyLFxOye4OaZa0Tkz1ghB/lS4wWXdY6UtsYo6oe3ouhWya/VYw/eeYX+OQwx5DRpKg==',key_name='tempest-keypair-1425767327',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-d01qmaxy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=d036404a-0828-40c3-afb4-b29ada8c5c4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "69e4a57b-d706-4230-8f71-faad4ffef57a", "address": "fa:16:3e:04:c0:81", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e4a57b-d7", "ovs_interfaceid": "69e4a57b-d706-4230-8f71-faad4ffef57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG os_vif [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69e4a57b-d7, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6ad7739-3b68-492f-821c-77de0b575c9f) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:41 user nova-compute[75703]: INFO os_vif [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=69e4a57b-d706-4230-8f71-faad4ffef57a,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e4a57b-d7')
Nov 10 15:15:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Deleting instance files /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b_del
Nov 10 15:15:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Deletion of /opt/stack/data/nova/instances/d036404a-0828-40c3-afb4-b29ada8c5c4b_del complete
Nov 10 15:15:41 user nova-compute[75703]: INFO nova.compute.manager [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 15:15:41 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:15:41 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:15:42 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Took 0.68 seconds to deallocate network for instance.
Nov 10 15:15:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-fc6e074c-0041-4f4c-99d2-e17c0d5ac0d8 req-55ebd386-fbe2-497d-963d-9958001667a3 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-vif-deleted-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:42 user nova-compute[75703]: INFO nova.compute.manager [req-fc6e074c-0041-4f4c-99d2-e17c0d5ac0d8 req-55ebd386-fbe2-497d-963d-9958001667a3 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Neutron deleted interface 69e4a57b-d706-4230-8f71-faad4ffef57a; detaching it from the instance and deleting it from the info cache
Nov 10 15:15:42 user nova-compute[75703]: DEBUG nova.network.neutron [req-fc6e074c-0041-4f4c-99d2-e17c0d5ac0d8 req-55ebd386-fbe2-497d-963d-9958001667a3 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-fc6e074c-0041-4f4c-99d2-e17c0d5ac0d8 req-55ebd386-fbe2-497d-963d-9958001667a3 service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Detach interface failed, port_id=69e4a57b-d706-4230-8f71-faad4ffef57a, reason: Instance d036404a-0828-40c3-afb4-b29ada8c5c4b could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:15:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:42 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Deleted allocations for instance d036404a-0828-40c3-afb4-b29ada8c5c4b
Nov 10 15:15:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e2c6beb0-f3a6-4768-bfff-b8983a7f4ad0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-74d9bd61-4043-407d-99d2-cf35812a9640 req-6750976d-c09f-44a8-b966-047c7d9742ae service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received event network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:15:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74d9bd61-4043-407d-99d2-cf35812a9640 req-6750976d-c09f-44a8-b966-047c7d9742ae service nova] Acquiring lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:15:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74d9bd61-4043-407d-99d2-cf35812a9640 req-6750976d-c09f-44a8-b966-047c7d9742ae service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:15:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74d9bd61-4043-407d-99d2-cf35812a9640 req-6750976d-c09f-44a8-b966-047c7d9742ae service nova] Lock "d036404a-0828-40c3-afb4-b29ada8c5c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:15:43 user nova-compute[75703]: DEBUG nova.compute.manager [req-74d9bd61-4043-407d-99d2-cf35812a9640 req-6750976d-c09f-44a8-b966-047c7d9742ae service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] No waiting events found dispatching network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:15:43 user nova-compute[75703]: WARNING nova.compute.manager [req-74d9bd61-4043-407d-99d2-cf35812a9640 req-6750976d-c09f-44a8-b966-047c7d9742ae service nova] [instance: d036404a-0828-40c3-afb4-b29ada8c5c4b] Received unexpected event network-vif-plugged-69e4a57b-d706-4230-8f71-faad4ffef57a for instance with vm_state deleted and task_state None.
Nov 10 15:15:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:15:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:15:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:15:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:15:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 is timed out.
Nov 10 15:16:00 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config.
Nov 10 15:16:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQxlrtaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:16:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da2a204-fd45-486c-af7a-075e17679a88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:16:00 user nova-compute[75703]: No targets found.
Nov 10 15:16:00 user nova-compute[75703]: iSNS:
Nov 10 15:16:00 user nova-compute[75703]: No targets found.
Nov 10 15:16:00 user nova-compute[75703]: STATIC:
Nov 10 15:16:00 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08
Nov 10 15:16:00 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:16:00 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:16:00 user nova-compute[75703]: FIRMWARE:
Nov 10 15:16:00 user nova-compute[75703]: No targets found.
Nov 10 15:16:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:16:00 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:16:00 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc66924-c09b-4abc-90c1-4fb2c1175377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[641909cf-4228-445d-9924-8ccacde6e893]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 (non-flash)
Nov 10 15:16:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 (non-flash)
Nov 10 15:16:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fa0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc60d4-bd2f-458c-8129-29f80b6e0e5a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d63ed-722c-4b83-9a14-9873e627d05f]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb446a-d3b7-4748-a02c-5990ff357cc7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[af716402-fae4-4a6e-860f-5db45b4635c0]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d91e5-36f8-4a7f-b479-d511987268bd]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2567ab0b-13f1-4b31-89c9-3ebc68d949c4]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260]
Nov 10 15:16:00 user nova-compute[75703]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08, portal: 172.16.0.220,3260] successful.
Nov 10 15:16:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccdd057a-175b-4d6d-9c6c-b88211441c08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d040f7a-9200-4d69-b525-54621b45e579]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== disconnect_volume: return (298ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:16:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:16:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:16:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8a1caa18-3e78-45e3-8452-6f8e3ba9bddc tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.826s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:16:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:16:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:16:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:16:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:16:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:16:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=24.97066879272461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:16:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:34 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:16:35 user nova-compute[75703]: INFO nova.compute.claims [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Claim successful on node user
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.network.neutron [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:16:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.policy [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1344068e16644f45bc9cb08cc0815b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52077a8ebd4f33ad9bc320ac3280fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:16:35 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Creating image(s)
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "/opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.190s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk 1073741824" returned: 0 in 0.059s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Successfully created port: 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Cannot resize image /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:36 user nova-compute[75703]: INFO nova.compute.manager [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attaching volume 121d1856-e622-4514-9063-3918d2ed7109 to /dev/vdb
Nov 10 15:16:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG os_brick.utils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77c3b5-4abe-42f1-86e7-aaef2a8841aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aa6093-9118-447a-85da-e4ddd844a799]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf37299-3a78-4045-830d-eca787ab37fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[745c7a0e-80cb-4805-b9f7-84b34bf75ede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:16:36 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91571f-093b-48f6-b391-2666348c3c73]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG os_brick.utils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating existing volume attachment record: 979f208e-a8f7-4dee-bd71-ccf48955cff5 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Successfully updated port: 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquired lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-changed-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG nova.compute.manager [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Refreshing instance network info cache due to event network-changed-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:16:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] Acquiring lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating instance_info_cache with network_info: [{"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Releasing lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Instance network_info: |[{"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] Acquired lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.neutron [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Refreshing network info cache for port 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Start _get_guest_xml network_info=[{"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:16:37 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:16:37 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48312118',display_name='tempest-AttachVolumeNegativeTest-server-48312118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48312118',id=49,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlLd7GEnakKiGzW4w9Kj0LjeDkvBZhpBj2m9Zx4dsZpDb/JGdVg6lo36tYYBPsUO10Ca61aMT5Y+cbLaCwCg07XcnjL/48hV/NFRvp3tMZhYEnVeEqqM/tnpGXKVaCl8A==',key_name='tempest-keypair-2034644734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-ciq5qlo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=15cc90af-afe3-4df9-9507-9d4b70ef4c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'pci_devices' on Instance uuid 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:16:37 user nova-compute[75703]:   <uuid>15cc90af-afe3-4df9-9507-9d4b70ef4c1d</uuid>
Nov 10 15:16:37 user nova-compute[75703]:   <name>instance-00000031</name>
Nov 10 15:16:37 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:16:37 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:16:37 user nova-compute[75703]:   <metadata>
Nov 10 15:16:37 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:16:37 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:16:37 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeNegativeTest-server-48312118</nova:name>
Nov 10 15:16:37 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:16:37</nova:creationTime>
Nov 10 15:16:37 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:16:37 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:16:37 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:16:37 user nova-compute[75703]:       <nova:owner>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:user uuid="1344068e16644f45bc9cb08cc0815b13">tempest-AttachVolumeNegativeTest-1477766545-project-member</nova:user>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:project uuid="ea52077a8ebd4f33ad9bc320ac3280fc">tempest-AttachVolumeNegativeTest-1477766545</nova:project>
Nov 10 15:16:37 user nova-compute[75703]:       </nova:owner>
Nov 10 15:16:37 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:16:37 user nova-compute[75703]:       <nova:ports>
Nov 10 15:16:37 user nova-compute[75703]:         <nova:port uuid="5385a95f-dee4-4c13-9a1c-6b6cfe5b9893">
Nov 10 15:16:37 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 15:16:37 user nova-compute[75703]:         </nova:port>
Nov 10 15:16:37 user nova-compute[75703]:       </nova:ports>
Nov 10 15:16:37 user nova-compute[75703]:     </nova:instance>
Nov 10 15:16:37 user nova-compute[75703]:   </metadata>
Nov 10 15:16:37 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:16:37 user nova-compute[75703]:     <system>
Nov 10 15:16:37 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:16:37 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:16:37 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:16:37 user nova-compute[75703]:       <entry name="serial">15cc90af-afe3-4df9-9507-9d4b70ef4c1d</entry>
Nov 10 15:16:37 user nova-compute[75703]:       <entry name="uuid">15cc90af-afe3-4df9-9507-9d4b70ef4c1d</entry>
Nov 10 15:16:37 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:16:37 user nova-compute[75703]:     </system>
Nov 10 15:16:37 user nova-compute[75703]:   </sysinfo>
Nov 10 15:16:37 user nova-compute[75703]:   <os>
Nov 10 15:16:37 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:16:37 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:16:37 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:16:37 user nova-compute[75703]:   </os>
Nov 10 15:16:37 user nova-compute[75703]:   <features>
Nov 10 15:16:37 user nova-compute[75703]:     <acpi/>
Nov 10 15:16:37 user nova-compute[75703]:     <apic/>
Nov 10 15:16:37 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:16:37 user nova-compute[75703]:   </features>
Nov 10 15:16:37 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:16:37 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:16:37 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:16:37 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:16:37 user nova-compute[75703]:   </clock>
Nov 10 15:16:37 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:16:37 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:16:37 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:16:37 user nova-compute[75703]:   </cpu>
Nov 10 15:16:37 user nova-compute[75703]:   <devices>
Nov 10 15:16:37 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:16:37 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:16:37 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk"/>
Nov 10 15:16:37 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:16:37 user nova-compute[75703]:     </disk>
Nov 10 15:16:37 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:16:37 user nova-compute[75703]:       <mac address="fa:16:3e:24:ad:26"/>
Nov 10 15:16:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:16:37 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:16:37 user nova-compute[75703]:       <target dev="tap5385a95f-de"/>
Nov 10 15:16:37 user nova-compute[75703]:     </interface>
Nov 10 15:16:37 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:16:37 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/console.log" append="off"/>
Nov 10 15:16:37 user nova-compute[75703]:     </serial>
Nov 10 15:16:37 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:16:37 user nova-compute[75703]:     <video>
Nov 10 15:16:37 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:16:37 user nova-compute[75703]:     </video>
Nov 10 15:16:37 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:16:37 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:16:37 user nova-compute[75703]:     </rng>
Nov 10 15:16:37 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:16:37 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:16:37 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:16:37 user nova-compute[75703]:     </memballoon>
Nov 10 15:16:37 user nova-compute[75703]:   </devices>
Nov 10 15:16:37 user nova-compute[75703]: </domain>
Nov 10 15:16:37 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48312118',display_name='tempest-AttachVolumeNegativeTest-server-48312118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48312118',id=49,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlLd7GEnakKiGzW4w9Kj0LjeDkvBZhpBj2m9Zx4dsZpDb/JGdVg6lo36tYYBPsUO10Ca61aMT5Y+cbLaCwCg07XcnjL/48hV/NFRvp3tMZhYEnVeEqqM/tnpGXKVaCl8A==',key_name='tempest-keypair-2034644734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-ciq5qlo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=15cc90af-afe3-4df9-9507-9d4b70ef4c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG os_vif [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8d7bca-12c7-5d64-8415-e9a0818614f9', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5385a95f-de, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5385a95f-de, col_values=(('qos', UUID('6c997754-4ec2-462a-8425-e5c901a21c45')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5385a95f-de, col_values=(('external_ids', {'iface-id': '5385a95f-dee4-4c13-9a1c-6b6cfe5b9893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:ad:26', 'vm-uuid': '15cc90af-afe3-4df9-9507-9d4b70ef4c1d'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:37 user nova-compute[75703]: INFO os_vif [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de')
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:16:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:24:ad:26, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:16:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updated VIF entry in instance network info cache for port 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:16:38 user nova-compute[75703]: DEBUG nova.network.neutron [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating instance_info_cache with network_info: [{"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:16:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-e05850f1-c147-4c7d-a761-e6f614ebd0da req-b20171ec-d6f3-43a6-b0cb-fbb06a605335 service nova] Releasing lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:16:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a3a7c7c-5967-4586-86c2-2e6376e2f184 req-40b4e13a-5913-41e3-9b92-3f7fb56d4d50 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:16:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a3a7c7c-5967-4586-86c2-2e6376e2f184 req-40b4e13a-5913-41e3-9b92-3f7fb56d4d50 service nova] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a3a7c7c-5967-4586-86c2-2e6376e2f184 req-40b4e13a-5913-41e3-9b92-3f7fb56d4d50 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-7a3a7c7c-5967-4586-86c2-2e6376e2f184 req-40b4e13a-5913-41e3-9b92-3f7fb56d4d50 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:39 user nova-compute[75703]: DEBUG nova.compute.manager [req-7a3a7c7c-5967-4586-86c2-2e6376e2f184 req-40b4e13a-5913-41e3-9b92-3f7fb56d4d50 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] No waiting events found dispatching network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:16:39 user nova-compute[75703]: WARNING nova.compute.manager [req-7a3a7c7c-5967-4586-86c2-2e6376e2f184 req-40b4e13a-5913-41e3-9b92-3f7fb56d4d50 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received unexpected event network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 for instance with vm_state building and task_state spawning.
Nov 10 15:16:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:16:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Instance spawned successfully.
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-c7af42c3-5bf7-47b8-843b-4819edad8ff3 req-d1ada1c8-2afc-4fdc-ab27-344707018da2 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c7af42c3-5bf7-47b8-843b-4819edad8ff3 req-d1ada1c8-2afc-4fdc-ab27-344707018da2 service nova] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c7af42c3-5bf7-47b8-843b-4819edad8ff3 req-d1ada1c8-2afc-4fdc-ab27-344707018da2 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-c7af42c3-5bf7-47b8-843b-4819edad8ff3 req-d1ada1c8-2afc-4fdc-ab27-344707018da2 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.compute.manager [req-c7af42c3-5bf7-47b8-843b-4819edad8ff3 req-d1ada1c8-2afc-4fdc-ab27-344707018da2 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] No waiting events found dispatching network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:16:41 user nova-compute[75703]: WARNING nova.compute.manager [req-c7af42c3-5bf7-47b8-843b-4819edad8ff3 req-d1ada1c8-2afc-4fdc-ab27-344707018da2 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received unexpected event network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 for instance with vm_state building and task_state spawning.
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:16:41 user nova-compute[75703]: INFO nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 10 15:16:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:16:41 user nova-compute[75703]: INFO nova.compute.manager [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Took 6.31 seconds to build instance.
Nov 10 15:16:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-369b7ee8-488f-4cf8-9c83-f96d2aa46a78 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.408s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:16:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:16:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltcIdqjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:17:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:17:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:17:00 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b511a-9e45-4e68-9060-a630fe32616b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:17:00 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274abab-056e-4191-8011-5058ab129fea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109] added
Nov 10 15:17:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630d333-0ac7-4a8e-a49d-fd545e964e1d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d26e678-789e-423a-937f-018e26d2cdf2]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ltcIdqjR {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ltcIdqjR" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd230cbf-6350-488f-9d6f-65df59694280]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ltcIdqjR'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55632921-c000-4a12-a70f-77b2ca11221f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5212bd4-0f7e-4d22-b062-52a882348328]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:17:00 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:17:00 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:17:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:17:00 user nova-compute[75703]: 
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[195745e9-278a-4343-8c5f-6f3f66c0f25b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260]
Nov 10 15:17:00 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260] successful.
Nov 10 15:17:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[831804e3-88f4-442d-8a00-3c2dd06c6aa3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c9bf0-5fdb-471f-8049-44f4a4b30b16]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 (non-flash)
Nov 10 15:17:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 (non-flash)
Nov 10 15:17:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58f7032-c52d-4a5d-9e84-67a2b0f9ef77]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltcIdqjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26462363366663136', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462363366663136', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:17:01 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:17:01 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:17:01 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:17:01 user nova-compute[75703]:   <serial>121d1856-e622-4514-9063-3918d2ed7109</serial>
Nov 10 15:17:01 user nova-compute[75703]: </disk>
Nov 10 15:17:01 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:17:01 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] No VIF found with MAC fa:16:3e:68:8d:e6, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:17:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-d52d6650-6164-433a-8e2e-28074b0c4e03 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.522s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:17:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:17:04 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:17:04 user nova-compute[75703]: INFO nova.compute.manager [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Detaching volume 121d1856-e622-4514-9063-3918d2ed7109
Nov 10 15:17:04 user nova-compute[75703]: INFO nova.virt.block_device [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Attempting to driver detach volume 121d1856-e622-4514-9063-3918d2ed7109 from mountpoint /dev/vdb
Nov 10 15:17:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Attempting to detach device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:17:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:17:04 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:17:04 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:17:04 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:17:04 user nova-compute[75703]:   <serial>121d1856-e622-4514-9063-3918d2ed7109</serial>
Nov 10 15:17:04 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:17:04 user nova-compute[75703]: </disk>
Nov 10 15:17:04 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:17:04 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the persistent domain config.
Nov 10 15:17:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:17:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:17:04 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:17:04 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:17:04 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:17:04 user nova-compute[75703]:   <serial>121d1856-e622-4514-9063-3918d2ed7109</serial>
Nov 10 15:17:04 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:17:04 user nova-compute[75703]: </disk>
Nov 10 15:17:04 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:17:04 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:17:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:17:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:17:20 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:17:21 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:17:22 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:17:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=24.93177032470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:17:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:17:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:17:24 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 is timed out.
Nov 10 15:17:24 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully detached device vdb from instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 from the live domain config.
Nov 10 15:17:24 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ltcIdqjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:17:24 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7983aa54-dcd1-4680-b4ab-87b20553e006]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:17:24 user nova-compute[75703]: No targets found.
Nov 10 15:17:24 user nova-compute[75703]: iSNS:
Nov 10 15:17:24 user nova-compute[75703]: No targets found.
Nov 10 15:17:24 user nova-compute[75703]: STATIC:
Nov 10 15:17:24 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109
Nov 10 15:17:24 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:17:24 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:17:24 user nova-compute[75703]: FIRMWARE:
Nov 10 15:17:24 user nova-compute[75703]: No targets found.
Nov 10 15:17:24 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:17:24 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:17:24 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aacfe4-67d8-431f-82a2-f6db14055b6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b64a3f-4e94-4974-9639-8a1725bbf4e6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 (non-flash)
Nov 10 15:17:24 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 (non-flash)
Nov 10 15:17:24 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fa0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ab47d-6d69-4d70-99c4-bb3a61779ebd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a52b1e0-ee85-4f7d-a660-9a8c5f6ad7d0]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2d5cd-1793-4f11-95a5-49a8c475c25a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[024c41df-efda-4fc0-9e11-1274572234cf]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929e8f8-85c6-4054-9d02-1db6fb201969]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e87fc2-18e8-4642-adf3-620c289c5b61]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260]
Nov 10 15:17:24 user nova-compute[75703]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109, portal: 172.16.0.220,3260] successful.
Nov 10 15:17:24 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121d1856-e622-4514-9063-3918d2ed7109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac168bcd-38e3-4988-9e7a-82ac937d7b14]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] <== disconnect_volume: return (273ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:17:24 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:17:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:25 user nova-compute[75703]: DEBUG nova.objects.instance [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'flavor' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:17:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-99ee94e8-e88e-4e16-80b0-3950002abca3 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:17:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:17:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:17:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:17:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Verify base images {{(pid=75703) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Image id 424c839a-ae27-4ecf-b640-8404a9fc9821 yields fingerprint 7cd78f2579a426079c6207b8f548d7a38e8925ef {{(pid=75703) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 15:17:46 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] image 424c839a-ae27-4ecf-b640-8404a9fc9821 at (/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef): checking
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] image 424c839a-ae27-4ecf-b640-8404a9fc9821 at (/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef): image is in use {{(pid=75703) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75703) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] 2c382d73-f36e-40e9-aec9-ce8c67a84641 is a valid instance name {{(pid=75703) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] 2c382d73-f36e-40e9-aec9-ce8c67a84641 has a disk file {{(pid=75703) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 is backed by 7cd78f2579a426079c6207b8f548d7a38e8925ef {{(pid=75703) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] 15cc90af-afe3-4df9-9507-9d4b70ef4c1d is a valid instance name {{(pid=75703) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] 15cc90af-afe3-4df9-9507-9d4b70ef4c1d has a disk file {{(pid=75703) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 15:17:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:17:47 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:17:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d is backed by 7cd78f2579a426079c6207b8f548d7a38e8925ef {{(pid=75703) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0
Nov 10 15:17:47 user nova-compute[75703]: WARNING nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Unknown base file: /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Active base files: /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Removable base files: /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5 /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330 /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7 /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40 /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5 /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0 /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c8b00128e0102a8ff9e05e875ef7a92475168f3c
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/be6f4d0c0129bd0006d832b78f4e0ecd31c2c0e5
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d0885cfe92ad84f04c0fc9edd56c73c900678330
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/193a886c68eb8209ca1ea3eac6dc64823fcab9d7
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8b15bbb60c269291ffdd4f3b8ce3eb1599a16f40
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0141c46734ea65f1a9cf1fe1316b74065cc6ee5
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/457f1cda5eda07dffad5f32abf2d8d8cdd7534f0
Nov 10 15:17:47 user nova-compute[75703]: INFO nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ceadb2b97d087b139f85e67e54d234e464554889
Nov 10 15:17:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Verification complete {{(pid=75703) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 15:17:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Verify swap images {{(pid=75703) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 15:17:47 user nova-compute[75703]: DEBUG nova.virt.libvirt.imagecache [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Verify ephemeral images {{(pid=75703) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 15:17:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:17:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:18:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:18:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:18:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:18:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:18:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:18:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:18:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:18:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:18:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:18:21 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating instance_info_cache with network_info: [{"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:18:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:18:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:18:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.930858612060547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:18:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:18:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-changed-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Refreshing instance network info cache due to event network-changed-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] Acquiring lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] Acquired lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:18:25 user nova-compute[75703]: DEBUG nova.network.neutron [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Refreshing network info cache for port 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:18:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updated VIF entry in instance network info cache for port 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:18:26 user nova-compute[75703]: DEBUG nova.network.neutron [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating instance_info_cache with network_info: [{"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:18:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-60c42b06-e215-4092-811b-4bef1ad1919d req-788a97c5-2d0f-493f-b367-9ed6d9012765 service nova] Releasing lock "refresh_cache-15cc90af-afe3-4df9-9507-9d4b70ef4c1d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:18:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:18:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:18:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:18:34 user nova-compute[75703]: DEBUG nova.objects.instance [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:18:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:18:35 user nova-compute[75703]: INFO nova.compute.manager [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Attaching volume 09737dc4-5766-47d3-943c-48169ad2c870 to /dev/vdb
Nov 10 15:18:35 user nova-compute[75703]: DEBUG os_brick.utils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf67a6b-b182-4608-ad91-7ebb4c6ab91b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f9e7c-797a-4b89-81ae-eb15d8b16400]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1043adf-1886-4ffe-9a49-2393671d0fd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e430e21a-8cae-47ac-9b26-1ee204846845]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:18:35 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:18:35 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc00be12-10e8-47e8-bd3a-70a44ea363af]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG os_brick.utils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:18:35 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating existing volume attachment record: db4e4fd7-cef8-4e39-97a9-4f2b68469ff7 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:18:36 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:18:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:18:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 5 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:18:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:18:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:18:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:18:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:18:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:18:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:18:42 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:52 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:18:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:02 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:07 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:12 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:19:17 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:19:22 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:19:23 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:19:23 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8819MB free_disk=24.929439544677734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 2c382d73-f36e-40e9-aec9-ce8c67a84641 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:19:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [{"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-2c382d73-f36e-40e9-aec9-ce8c67a84641" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:27 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMspctRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:19:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:19:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:19:29 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1cd9f-8d1a-47f4-881f-5c75ed3ec0f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:19:29 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee81956-d2ed-447f-a002-1edaf85d69fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870] added
Nov 10 15:19:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c9e661-2248-4a2d-ab5a-fd5c3aba1a11]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[228bca6e-759a-4fee-bd69-61b5986b3bc9]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMspctRO {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMspctRO" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0ceabd-b079-4f78-9b6a-47f1d6befb50]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMspctRO'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb4f6f-5fc7-4fd3-9730-c409e2f52dea]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040fbe2-dc3a-4dbd-b4f7-85c6fb6c48f1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:19:29 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:19:29 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:19:29 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:19:29 user nova-compute[75703]: 
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[363fe12e-5dc3-4379-a6f6-ad212115ba31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260]
Nov 10 15:19:29 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260] successful.
Nov 10 15:19:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62109c2-77bf-4261-9558-dc0783a8fb96]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acacbe-dacd-40fb-9d79-0d5ba5568c9a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 (non-flash)
Nov 10 15:19:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 (non-flash)
Nov 10 15:19:29 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f09d5df-acef-4e0f-a8bd-6e047bbcd949]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMspctRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23131656138363832', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131656138363832', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG nova.objects.instance [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:19:30 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:19:30 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:19:30 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:19:30 user nova-compute[75703]:   <serial>09737dc4-5766-47d3-943c-48169ad2c870</serial>
Nov 10 15:19:30 user nova-compute[75703]: </disk>
Nov 10 15:19:30 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:24:ad:26, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:19:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-40056e1a-8f33-4ce9-aaf1-cadf5777df37 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.846s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:31 user nova-compute[75703]: INFO nova.compute.manager [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Detaching volume 09737dc4-5766-47d3-943c-48169ad2c870
Nov 10 15:19:32 user nova-compute[75703]: INFO nova.virt.block_device [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Attempting to driver detach volume 09737dc4-5766-47d3-943c-48169ad2c870 from mountpoint /dev/vdb
Nov 10 15:19:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Attempting to detach device vdb from instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:19:32 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:19:32 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:19:32 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:19:32 user nova-compute[75703]:   <serial>09737dc4-5766-47d3-943c-48169ad2c870</serial>
Nov 10 15:19:32 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:19:32 user nova-compute[75703]: </disk>
Nov 10 15:19:32 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:19:32 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully detached device vdb from instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d from the persistent domain config.
Nov 10 15:19:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:19:32 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:19:32 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:19:32 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:19:32 user nova-compute[75703]:   <serial>09737dc4-5766-47d3-943c-48169ad2c870</serial>
Nov 10 15:19:32 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:19:32 user nova-compute[75703]: </disk>
Nov 10 15:19:32 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:32 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:19:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:37 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:40 user nova-compute[75703]: INFO nova.compute.manager [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Terminating instance
Nov 10 15:19:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-34a327c8-a9c3-4f28-9415-295a24b9ff05 req-c9ba0dbf-8be7-4cd9-ad4c-52776ca0833b service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-vif-unplugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-34a327c8-a9c3-4f28-9415-295a24b9ff05 req-c9ba0dbf-8be7-4cd9-ad4c-52776ca0833b service nova] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-34a327c8-a9c3-4f28-9415-295a24b9ff05 req-c9ba0dbf-8be7-4cd9-ad4c-52776ca0833b service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-34a327c8-a9c3-4f28-9415-295a24b9ff05 req-c9ba0dbf-8be7-4cd9-ad4c-52776ca0833b service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-34a327c8-a9c3-4f28-9415-295a24b9ff05 req-c9ba0dbf-8be7-4cd9-ad4c-52776ca0833b service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] No waiting events found dispatching network-vif-unplugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG nova.compute.manager [req-34a327c8-a9c3-4f28-9415-295a24b9ff05 req-c9ba0dbf-8be7-4cd9-ad4c-52776ca0833b service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-vif-unplugged-b7c0f108-248d-4cc7-8f98-310482a30009 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:19:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Instance destroyed successfully.
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lazy-loading 'resources' on Instance uuid 2c382d73-f36e-40e9-aec9-ce8c67a84641 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1081710307',display_name='tempest-SnapshotDataIntegrityTests-server-1081710307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1081710307',id=44,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlKmybVD5mGrOzrg43T5refa5n1R4AcJnTVU8jJv4iMgZ2nr6gZLSViMjXr6TSv1VdDRaHXttG0sPEM1wvQ3GmwQ0FH0LvBPTQS8i38UyznoAPJKxmyd80na1u1maoyfQ==',key_name='tempest-keypair-72257052',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='057af934a5324de19a6c05e2a0379f92',ramdisk_id='',reservation_id='r-24tr0uzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-499333430',owner_user_name='tempest-SnapshotDataIntegrityTests-499333430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d775cbe0387444bb85fcef28385a65c',uuid=2c382d73-f36e-40e9-aec9-ce8c67a84641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Converting VIF {"id": "b7c0f108-248d-4cc7-8f98-310482a30009", "address": "fa:16:3e:68:8d:e6", "network": {"id": "98da56cf-c9c9-4e76-93e0-e8f7cbb608b1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-714977403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "057af934a5324de19a6c05e2a0379f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7c0f108-24", "ovs_interfaceid": "b7c0f108-248d-4cc7-8f98-310482a30009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG os_vif [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7c0f108-24, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a1cc146-f2fe-4f53-8ccf-3156ee79b6f5) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:41 user nova-compute[75703]: INFO os_vif [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:8d:e6,bridge_name='br-int',has_traffic_filtering=True,id=b7c0f108-248d-4cc7-8f98-310482a30009,network=Network(98da56cf-c9c9-4e76-93e0-e8f7cbb608b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7c0f108-24')
Nov 10 15:19:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Deleting instance files /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641_del
Nov 10 15:19:41 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Deletion of /opt/stack/data/nova/instances/2c382d73-f36e-40e9-aec9-ce8c67a84641_del complete
Nov 10 15:19:41 user nova-compute[75703]: INFO nova.compute.manager [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 15:19:41 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:19:41 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Took 0.68 seconds to deallocate network for instance.
Nov 10 15:19:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:41 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:42 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Deleted allocations for instance 2c382d73-f36e-40e9-aec9-ce8c67a84641
Nov 10 15:19:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-fb9c82f8-3c62-4d80-b80a-8841e7b75651 tempest-SnapshotDataIntegrityTests-499333430 tempest-SnapshotDataIntegrityTests-499333430-project-member] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.861s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] Acquiring lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] Lock "2c382d73-f36e-40e9-aec9-ce8c67a84641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] No waiting events found dispatching network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:19:42 user nova-compute[75703]: WARNING nova.compute.manager [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received unexpected event network-vif-plugged-b7c0f108-248d-4cc7-8f98-310482a30009 for instance with vm_state deleted and task_state None.
Nov 10 15:19:42 user nova-compute[75703]: DEBUG nova.compute.manager [req-13e4ff92-891d-431a-b02e-b8063141f3e2 req-055c1a2a-48c2-4ac8-9854-c1f288b1fa0c service nova] [instance: 2c382d73-f36e-40e9-aec9-ce8c67a84641] Received event network-vif-deleted-b7c0f108-248d-4cc7-8f98-310482a30009 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:19:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:52 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d is timed out.
Nov 10 15:19:52 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully detached device vdb from instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d from the live domain config.
Nov 10 15:19:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMspctRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:19:52 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba1818-2883-4530-9b8b-ea267a7a5007]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:19:52 user nova-compute[75703]: No targets found.
Nov 10 15:19:52 user nova-compute[75703]: iSNS:
Nov 10 15:19:52 user nova-compute[75703]: No targets found.
Nov 10 15:19:52 user nova-compute[75703]: STATIC:
Nov 10 15:19:52 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870
Nov 10 15:19:52 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:19:52 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:19:52 user nova-compute[75703]: FIRMWARE:
Nov 10 15:19:52 user nova-compute[75703]: No targets found.
Nov 10 15:19:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:19:52 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:19:52 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39724d1-786a-4dcd-a0af-5e1186216bf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94af8ed-44bc-49e0-a6e6-5a08a6bc3011]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 (non-flash)
Nov 10 15:19:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 (non-flash)
Nov 10 15:19:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a429cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1769dfad-8472-4221-a2c2-ebb63a4c3269]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a504eb06-9482-45f5-8d8b-7813660191bd]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1539052-292c-4f0d-9057-114e5ef91a3a]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[140223f9-a08a-40f9-bfc2-57f39e8a27e6]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedd9392-b8de-4a31-829d-bb4178a9a04d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91cb51e-3c99-4229-8d6c-b40f1bba038a]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260]
Nov 10 15:19:52 user nova-compute[75703]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870, portal: 172.16.0.220,3260] successful.
Nov 10 15:19:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09737dc4-5766-47d3-943c-48169ad2c870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64af7cb-799d-45ee-b1ba-bfdc72ad09a3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== disconnect_volume: return (284ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:19:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:19:53 user nova-compute[75703]: DEBUG nova.objects.instance [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:19:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-22245458-9e81-45b9-931b-0b0b452fc388 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_power_states {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:19:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 15:19:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:19:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:19:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:19:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:19:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:19:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:19:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:19:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:20:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:20:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:20:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:15 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:15 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:20:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:22 user nova-compute[75703]: INFO nova.compute.manager [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Terminating instance
Nov 10 15:20:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-291939d3-db49-41cf-a636-92cbcbcbaafc req-1ceb52a9-595b-4a28-a8ca-46340fad5e65 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-vif-unplugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-291939d3-db49-41cf-a636-92cbcbcbaafc req-1ceb52a9-595b-4a28-a8ca-46340fad5e65 service nova] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-291939d3-db49-41cf-a636-92cbcbcbaafc req-1ceb52a9-595b-4a28-a8ca-46340fad5e65 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-291939d3-db49-41cf-a636-92cbcbcbaafc req-1ceb52a9-595b-4a28-a8ca-46340fad5e65 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-291939d3-db49-41cf-a636-92cbcbcbaafc req-1ceb52a9-595b-4a28-a8ca-46340fad5e65 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] No waiting events found dispatching network-vif-unplugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-291939d3-db49-41cf-a636-92cbcbcbaafc req-1ceb52a9-595b-4a28-a8ca-46340fad5e65 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-vif-unplugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:20:22 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Instance destroyed successfully.
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'resources' on Instance uuid 15cc90af-afe3-4df9-9507-9d4b70ef4c1d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48312118',display_name='tempest-AttachVolumeNegativeTest-server-48312118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48312118',id=49,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlLd7GEnakKiGzW4w9Kj0LjeDkvBZhpBj2m9Zx4dsZpDb/JGdVg6lo36tYYBPsUO10Ca61aMT5Y+cbLaCwCg07XcnjL/48hV/NFRvp3tMZhYEnVeEqqM/tnpGXKVaCl8A==',key_name='tempest-keypair-2034644734',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:16:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-ciq5qlo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=15cc90af-afe3-4df9-9507-9d4b70ef4c1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "address": "fa:16:3e:24:ad:26", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5385a95f-de", "ovs_interfaceid": "5385a95f-dee4-4c13-9a1c-6b6cfe5b9893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG os_vif [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5385a95f-de, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c997754-4ec2-462a-8425-e5c901a21c45) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:23 user nova-compute[75703]: INFO os_vif [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:ad:26,bridge_name='br-int',has_traffic_filtering=True,id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5385a95f-de')
Nov 10 15:20:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Deleting instance files /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d_del
Nov 10 15:20:23 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Deletion of /opt/stack/data/nova/instances/15cc90af-afe3-4df9-9507-9d4b70ef4c1d_del complete
Nov 10 15:20:23 user nova-compute[75703]: INFO nova.compute.manager [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 15:20:23 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:20:23 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Took 0.68 seconds to deallocate network for instance.
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-a4915108-0bd3-4f9f-bfca-609bc5011920 req-c837ae7b-d4f7-49e5-965f-717742fca202 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-vif-deleted-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:20:23 user nova-compute[75703]: INFO nova.compute.manager [req-a4915108-0bd3-4f9f-bfca-609bc5011920 req-c837ae7b-d4f7-49e5-965f-717742fca202 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Neutron deleted interface 5385a95f-dee4-4c13-9a1c-6b6cfe5b9893; detaching it from the instance and deleting it from the info cache
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.network.neutron [req-a4915108-0bd3-4f9f-bfca-609bc5011920 req-c837ae7b-d4f7-49e5-965f-717742fca202 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.compute.manager [req-a4915108-0bd3-4f9f-bfca-609bc5011920 req-c837ae7b-d4f7-49e5-965f-717742fca202 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Detach interface failed, port_id=5385a95f-dee4-4c13-9a1c-6b6cfe5b9893, reason: Instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:20:23 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:24 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Deleted allocations for instance 15cc90af-afe3-4df9-9507-9d4b70ef4c1d
Nov 10 15:20:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2542ae7b-b889-46e1-a1c2-fb5558f7d203 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-78045f96-9a3a-4e40-b8b5-dddc15bc80d2 req-7914f4cf-2f51-4ee5-84a2-b54c47852534 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received event network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-78045f96-9a3a-4e40-b8b5-dddc15bc80d2 req-7914f4cf-2f51-4ee5-84a2-b54c47852534 service nova] Acquiring lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-78045f96-9a3a-4e40-b8b5-dddc15bc80d2 req-7914f4cf-2f51-4ee5-84a2-b54c47852534 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-78045f96-9a3a-4e40-b8b5-dddc15bc80d2 req-7914f4cf-2f51-4ee5-84a2-b54c47852534 service nova] Lock "15cc90af-afe3-4df9-9507-9d4b70ef4c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.manager [req-78045f96-9a3a-4e40-b8b5-dddc15bc80d2 req-7914f4cf-2f51-4ee5-84a2-b54c47852534 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] No waiting events found dispatching network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:20:25 user nova-compute[75703]: WARNING nova.compute.manager [req-78045f96-9a3a-4e40-b8b5-dddc15bc80d2 req-7914f4cf-2f51-4ee5-84a2-b54c47852534 service nova] [instance: 15cc90af-afe3-4df9-9507-9d4b70ef4c1d] Received unexpected event network-vif-plugged-5385a95f-dee4-4c13-9a1c-6b6cfe5b9893 for instance with vm_state deleted and task_state None.
Nov 10 15:20:25 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:20:25 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=24.98430633544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:20:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:20:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:20:26 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:20:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:20:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:20:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:20:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:21:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:21:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:16 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:21:17 user nova-compute[75703]: INFO nova.compute.claims [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Claim successful on node user
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:21:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.policy [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1344068e16644f45bc9cb08cc0815b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea52077a8ebd4f33ad9bc320ac3280fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:21:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Creating image(s)
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "/opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.169s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk 1073741824" returned: 0 in 0.054s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:17 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Cannot resize image /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Ensure instance console log exists: /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Successfully created port: 89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Successfully updated port: 89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquired lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:21:18 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-changed-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.compute.manager [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Refreshing instance network info cache due to event network-changed-89810225-da25-4bac-92b2-9dc7f2d18f30. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] Acquiring lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.neutron [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Releasing lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Instance network_info: |[{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] Acquired lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.neutron [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Refreshing network info cache for port 89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Start _get_guest_xml network_info=[{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:21:19 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:21:19 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-209208659',display_name='tempest-AttachVolumeNegativeTest-server-209208659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-209208659',id=50,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4EHYoBgLBLnEf2bke9KCe7Cu939qtS2Nw3aDboJE8fkayi71paU1r7soYdnK7V82sb75zuEONPNPavqFPpJS6wQFZ9+UNixRrxN1ue4o0AT+8H5v2UIWjKldY4220Mmw==',key_name='tempest-keypair-1609163690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-euxr4xph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=7ba759d6-fa79-49af-a3c2-342957048d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.objects.instance [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:21:19 user nova-compute[75703]:   <uuid>7ba759d6-fa79-49af-a3c2-342957048d08</uuid>
Nov 10 15:21:19 user nova-compute[75703]:   <name>instance-00000032</name>
Nov 10 15:21:19 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:21:19 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:21:19 user nova-compute[75703]:   <metadata>
Nov 10 15:21:19 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:21:19 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:21:19 user nova-compute[75703]:       <nova:name>tempest-AttachVolumeNegativeTest-server-209208659</nova:name>
Nov 10 15:21:19 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:21:19</nova:creationTime>
Nov 10 15:21:19 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:21:19 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:21:19 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:21:19 user nova-compute[75703]:       <nova:owner>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:user uuid="1344068e16644f45bc9cb08cc0815b13">tempest-AttachVolumeNegativeTest-1477766545-project-member</nova:user>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:project uuid="ea52077a8ebd4f33ad9bc320ac3280fc">tempest-AttachVolumeNegativeTest-1477766545</nova:project>
Nov 10 15:21:19 user nova-compute[75703]:       </nova:owner>
Nov 10 15:21:19 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:21:19 user nova-compute[75703]:       <nova:ports>
Nov 10 15:21:19 user nova-compute[75703]:         <nova:port uuid="89810225-da25-4bac-92b2-9dc7f2d18f30">
Nov 10 15:21:19 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 15:21:19 user nova-compute[75703]:         </nova:port>
Nov 10 15:21:19 user nova-compute[75703]:       </nova:ports>
Nov 10 15:21:19 user nova-compute[75703]:     </nova:instance>
Nov 10 15:21:19 user nova-compute[75703]:   </metadata>
Nov 10 15:21:19 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:21:19 user nova-compute[75703]:     <system>
Nov 10 15:21:19 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:21:19 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:21:19 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:21:19 user nova-compute[75703]:       <entry name="serial">7ba759d6-fa79-49af-a3c2-342957048d08</entry>
Nov 10 15:21:19 user nova-compute[75703]:       <entry name="uuid">7ba759d6-fa79-49af-a3c2-342957048d08</entry>
Nov 10 15:21:19 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:21:19 user nova-compute[75703]:     </system>
Nov 10 15:21:19 user nova-compute[75703]:   </sysinfo>
Nov 10 15:21:19 user nova-compute[75703]:   <os>
Nov 10 15:21:19 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:21:19 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:21:19 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:21:19 user nova-compute[75703]:   </os>
Nov 10 15:21:19 user nova-compute[75703]:   <features>
Nov 10 15:21:19 user nova-compute[75703]:     <acpi/>
Nov 10 15:21:19 user nova-compute[75703]:     <apic/>
Nov 10 15:21:19 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:21:19 user nova-compute[75703]:   </features>
Nov 10 15:21:19 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:21:19 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:21:19 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:21:19 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:21:19 user nova-compute[75703]:   </clock>
Nov 10 15:21:19 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:21:19 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:21:19 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:21:19 user nova-compute[75703]:   </cpu>
Nov 10 15:21:19 user nova-compute[75703]:   <devices>
Nov 10 15:21:19 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:21:19 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:21:19 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk"/>
Nov 10 15:21:19 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:21:19 user nova-compute[75703]:     </disk>
Nov 10 15:21:19 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:21:19 user nova-compute[75703]:       <mac address="fa:16:3e:74:df:e8"/>
Nov 10 15:21:19 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:21:19 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:21:19 user nova-compute[75703]:       <target dev="tap89810225-da"/>
Nov 10 15:21:19 user nova-compute[75703]:     </interface>
Nov 10 15:21:19 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:21:19 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/console.log" append="off"/>
Nov 10 15:21:19 user nova-compute[75703]:     </serial>
Nov 10 15:21:19 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:21:19 user nova-compute[75703]:     <video>
Nov 10 15:21:19 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:21:19 user nova-compute[75703]:     </video>
Nov 10 15:21:19 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:21:19 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:21:19 user nova-compute[75703]:     </rng>
Nov 10 15:21:19 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:21:19 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:21:19 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:21:19 user nova-compute[75703]:     </memballoon>
Nov 10 15:21:19 user nova-compute[75703]:   </devices>
Nov 10 15:21:19 user nova-compute[75703]: </domain>
Nov 10 15:21:19 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-209208659',display_name='tempest-AttachVolumeNegativeTest-server-209208659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-209208659',id=50,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4EHYoBgLBLnEf2bke9KCe7Cu939qtS2Nw3aDboJE8fkayi71paU1r7soYdnK7V82sb75zuEONPNPavqFPpJS6wQFZ9+UNixRrxN1ue4o0AT+8H5v2UIWjKldY4220Mmw==',key_name='tempest-keypair-1609163690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-euxr4xph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=7ba759d6-fa79-49af-a3c2-342957048d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG os_vif [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c4b54e1-a372-55bf-8613-0a0401e52c1a', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89810225-da, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89810225-da, col_values=(('qos', UUID('ad19fc3a-b7b7-47ea-9669-afd17aaab21c')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89810225-da, col_values=(('external_ids', {'iface-id': '89810225-da25-4bac-92b2-9dc7f2d18f30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:df:e8', 'vm-uuid': '7ba759d6-fa79-49af-a3c2-342957048d08'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:19 user nova-compute[75703]: INFO os_vif [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da')
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:74:df:e8, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.neutron [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updated VIF entry in instance network info cache for port 89810225-da25-4bac-92b2-9dc7f2d18f30. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG nova.network.neutron [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:21:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-94650786-cc27-43f5-add6-4ae202ef474f req-d4327988-2b21-425b-98ec-24ef83eacc4b service nova] Releasing lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-ea2556f4-1303-4b12-be17-14e73be6ce6a req-e5230af5-12ef-4a45-8d51-735e0f007bf9 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ea2556f4-1303-4b12-be17-14e73be6ce6a req-e5230af5-12ef-4a45-8d51-735e0f007bf9 service nova] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ea2556f4-1303-4b12-be17-14e73be6ce6a req-e5230af5-12ef-4a45-8d51-735e0f007bf9 service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ea2556f4-1303-4b12-be17-14e73be6ce6a req-e5230af5-12ef-4a45-8d51-735e0f007bf9 service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:20 user nova-compute[75703]: DEBUG nova.compute.manager [req-ea2556f4-1303-4b12-be17-14e73be6ce6a req-e5230af5-12ef-4a45-8d51-735e0f007bf9 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] No waiting events found dispatching network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:21:20 user nova-compute[75703]: WARNING nova.compute.manager [req-ea2556f4-1303-4b12-be17-14e73be6ce6a req-e5230af5-12ef-4a45-8d51-735e0f007bf9 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received unexpected event network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 for instance with vm_state building and task_state spawning.
Nov 10 15:21:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:21:22 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Instance spawned successfully.
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-f252f035-594b-4886-909b-d596a10c6b3f req-e3e36738-6fff-4769-b7f3-b6b8def0d03a service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f252f035-594b-4886-909b-d596a10c6b3f req-e3e36738-6fff-4769-b7f3-b6b8def0d03a service nova] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f252f035-594b-4886-909b-d596a10c6b3f req-e3e36738-6fff-4769-b7f3-b6b8def0d03a service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f252f035-594b-4886-909b-d596a10c6b3f req-e3e36738-6fff-4769-b7f3-b6b8def0d03a service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.compute.manager [req-f252f035-594b-4886-909b-d596a10c6b3f req-e3e36738-6fff-4769-b7f3-b6b8def0d03a service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] No waiting events found dispatching network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:21:22 user nova-compute[75703]: WARNING nova.compute.manager [req-f252f035-594b-4886-909b-d596a10c6b3f req-e3e36738-6fff-4769-b7f3-b6b8def0d03a service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received unexpected event network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 for instance with vm_state building and task_state spawning.
Nov 10 15:21:22 user nova-compute[75703]: INFO nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 10 15:21:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:21:22 user nova-compute[75703]: INFO nova.compute.manager [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Took 5.91 seconds to build instance.
Nov 10 15:21:22 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-2da8cad4-8de5-4c7b-b7c1-044ad838f6a0 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.999s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:21:24 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:21:25 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:21:25 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=24.981365203857422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 7ba759d6-fa79-49af-a3c2-342957048d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:21:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:21:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:26 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:21:27 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:21:28 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:21:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:21:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:21:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:21:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:21:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:21:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:22:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:22:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:22:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:22:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:22:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:22:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:22:26 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:22:26 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.95293426513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 7ba759d6-fa79-49af-a3c2-342957048d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:22:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:22:28 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:22:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:22:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:22:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:22:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:22:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:22:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:23:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-changed-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG nova.compute.manager [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Refreshing instance network info cache due to event network-changed-89810225-da25-4bac-92b2-9dc7f2d18f30. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] Acquiring lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] Acquired lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Refreshing network info cache for port 89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updated VIF entry in instance network info cache for port 89810225-da25-4bac-92b2-9dc7f2d18f30. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG nova.network.neutron [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:23:08 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-f652c863-9d02-4c2d-a1d8-441a7099f9a7 req-8287f10c-341d-4eb4-b57e-eed8b004b31c service nova] Releasing lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:23:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:23:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:23:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:23:13 user nova-compute[75703]: DEBUG nova.objects.instance [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:23:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:23:14 user nova-compute[75703]: INFO nova.compute.manager [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Attaching volume d650ec6a-fbc0-4f97-882f-1bb341ea614a to /dev/vdb
Nov 10 15:23:14 user nova-compute[75703]: DEBUG os_brick.utils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[05153d26-4e39-4969-b561-c9a12f71b164]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a84d0f1-856f-475a-8598-d36707610e56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[71be868d-2d46-4909-ad85-0731d720d1e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0c7daf-3b3a-4fd7-a15c-9276f0ae96dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:23:14 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:23:14 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b8b82b-8080-47ac-8c0c-7fc4937e2002]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG os_brick.utils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating existing volume attachment record: 7256677f-41f8-4ec9-98e5-82a881257deb {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:23:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:17 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:23:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:23:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:23:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:23:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:23:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:23:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:26 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:23:26 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.952075958251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 7ba759d6-fa79-49af-a3c2-342957048d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:23:26 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:23:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:23:29 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:23:30 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [{"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:23:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-7ba759d6-fa79-49af-a3c2-342957048d08" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:23:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:23:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:34 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJesEaGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:23:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:23:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:23:37 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[82419aea-d9a7-41a5-b84e-f22ab2744019]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:23:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0021a08-1b71-4384-9b1a-1987222e38d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a] added
Nov 10 15:23:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[73979c85-29e6-4731-8ab9-957e94c39659]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b5d23-78d2-4b3e-9940-2f3f1ad26575]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJesEaGt {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJesEaGt" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[406cc02d-4b78-4bb9-8c79-554ae741d5a3]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJesEaGt'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087f2f5-7582-474a-9ffe-e74d98f23772]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eda6846-7576-4133-9b49-4da1851c6660]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:23:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:23:37 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:23:37 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:23:37 user nova-compute[75703]: 
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd416776-3615-4fe0-be46-3e7308f47059]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260]
Nov 10 15:23:37 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260] successful.
Nov 10 15:23:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe17ed8b-5aa8-4211-833f-87d09938e497]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[73983486-f17f-4a06-8b1d-81f5fc4d048f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a (non-flash)
Nov 10 15:23:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a (non-flash)
Nov 10 15:23:37 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df19d3c-f20b-4ced-9c60-8be16b83374c]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:23:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJesEaGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26464666431643962', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464666431643962', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG nova.objects.instance [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:23:38 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:23:38 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:23:38 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:23:38 user nova-compute[75703]:   <serial>d650ec6a-fbc0-4f97-882f-1bb341ea614a</serial>
Nov 10 15:23:38 user nova-compute[75703]: </disk>
Nov 10 15:23:38 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] No VIF found with MAC fa:16:3e:74:df:e8, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:23:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-da8f6ae1-20df-44b9-bb6d-622ac2873a70 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.877s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:23:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:23:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:23:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:23:40 user nova-compute[75703]: INFO nova.compute.manager [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Detaching volume d650ec6a-fbc0-4f97-882f-1bb341ea614a
Nov 10 15:23:40 user nova-compute[75703]: INFO nova.virt.block_device [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Attempting to driver detach volume d650ec6a-fbc0-4f97-882f-1bb341ea614a from mountpoint /dev/vdb
Nov 10 15:23:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Attempting to detach device vdb from instance 7ba759d6-fa79-49af-a3c2-342957048d08 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:23:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:23:40 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:23:40 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:23:40 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:23:40 user nova-compute[75703]:   <serial>d650ec6a-fbc0-4f97-882f-1bb341ea614a</serial>
Nov 10 15:23:40 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:23:40 user nova-compute[75703]: </disk>
Nov 10 15:23:40 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:23:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:40 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully detached device vdb from instance 7ba759d6-fa79-49af-a3c2-342957048d08 from the persistent domain config.
Nov 10 15:23:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ba759d6-fa79-49af-a3c2-342957048d08 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:23:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:23:40 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:23:40 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:23:40 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:23:40 user nova-compute[75703]:   <serial>d650ec6a-fbc0-4f97-882f-1bb341ea614a</serial>
Nov 10 15:23:40 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:23:40 user nova-compute[75703]: </disk>
Nov 10 15:23:40 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:23:40 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:23:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:23:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:23:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:23:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:23:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:23:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 5 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:23:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:23:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:00 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ba759d6-fa79-49af-a3c2-342957048d08 is timed out.
Nov 10 15:24:00 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully detached device vdb from instance 7ba759d6-fa79-49af-a3c2-342957048d08 from the live domain config.
Nov 10 15:24:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJesEaGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:24:00 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c80275-4a58-4f9d-a73d-dc2344280a69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:24:00 user nova-compute[75703]: No targets found.
Nov 10 15:24:00 user nova-compute[75703]: iSNS:
Nov 10 15:24:00 user nova-compute[75703]: No targets found.
Nov 10 15:24:00 user nova-compute[75703]: STATIC:
Nov 10 15:24:00 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a
Nov 10 15:24:00 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:24:00 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:24:00 user nova-compute[75703]: FIRMWARE:
Nov 10 15:24:00 user nova-compute[75703]: No targets found.
Nov 10 15:24:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:24:00 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:24:00 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7560590e-bd76-47bf-a19b-945d9e0be1e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc115df-f5cd-4037-bfb3-9b4a4bfee2cf]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a (non-flash)
Nov 10 15:24:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a (non-flash)
Nov 10 15:24:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4a43eb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e184d6-7513-4d9a-9dfd-77029e8c0a1b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e39e332-06ff-46a7-910b-66ad0a69caff]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffedeea-2afa-4ba8-81f5-ddc09e10624d]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58e4e7-9c0a-40c3-bc40-0ec06c008ccb]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d45fde-e7cc-4bf9-8aa9-b184461f6376]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6140a1-7ae8-4029-9125-5c7ca01fb50f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260]
Nov 10 15:24:00 user nova-compute[75703]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a, portal: 172.16.0.220,3260] successful.
Nov 10 15:24:00 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d650ec6a-fbc0-4f97-882f-1bb341ea614a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[387a2bb7-b010-4d5a-9b0b-0fcd325b4c59]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] <== disconnect_volume: return (273ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:24:00 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:24:01 user nova-compute[75703]: DEBUG nova.objects.instance [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'flavor' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:24:01 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-df0bac2f-a948-4322-9f43-2a8e4cafd369 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:24:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:24:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:24:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:24:27 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:24:28 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:24:28 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.943435668945312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 7ba759d6-fa79-49af-a3c2-342957048d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:24:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:30 user nova-compute[75703]: INFO nova.compute.manager [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Terminating instance
Nov 10 15:24:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-acdaca03-f6f8-4776-89d5-e5d6f28f8f66 req-c20028e4-9aa9-4734-aa65-66ad0ddc1f4a service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-vif-unplugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-acdaca03-f6f8-4776-89d5-e5d6f28f8f66 req-c20028e4-9aa9-4734-aa65-66ad0ddc1f4a service nova] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-acdaca03-f6f8-4776-89d5-e5d6f28f8f66 req-c20028e4-9aa9-4734-aa65-66ad0ddc1f4a service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-acdaca03-f6f8-4776-89d5-e5d6f28f8f66 req-c20028e4-9aa9-4734-aa65-66ad0ddc1f4a service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-acdaca03-f6f8-4776-89d5-e5d6f28f8f66 req-c20028e4-9aa9-4734-aa65-66ad0ddc1f4a service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] No waiting events found dispatching network-vif-unplugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG nova.compute.manager [req-acdaca03-f6f8-4776-89d5-e5d6f28f8f66 req-c20028e4-9aa9-4734-aa65-66ad0ddc1f4a service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-vif-unplugged-89810225-da25-4bac-92b2-9dc7f2d18f30 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:24:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Instance destroyed successfully.
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.objects.instance [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lazy-loading 'resources' on Instance uuid 7ba759d6-fa79-49af-a3c2-342957048d08 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-209208659',display_name='tempest-AttachVolumeNegativeTest-server-209208659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-209208659',id=50,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4EHYoBgLBLnEf2bke9KCe7Cu939qtS2Nw3aDboJE8fkayi71paU1r7soYdnK7V82sb75zuEONPNPavqFPpJS6wQFZ9+UNixRrxN1ue4o0AT+8H5v2UIWjKldY4220Mmw==',key_name='tempest-keypair-1609163690',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea52077a8ebd4f33ad9bc320ac3280fc',ramdisk_id='',reservation_id='r-euxr4xph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1477766545',owner_user_name='tempest-AttachVolumeNegativeTest-1477766545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1344068e16644f45bc9cb08cc0815b13',uuid=7ba759d6-fa79-49af-a3c2-342957048d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converting VIF {"id": "89810225-da25-4bac-92b2-9dc7f2d18f30", "address": "fa:16:3e:74:df:e8", "network": {"id": "9252a479-cecb-4bd0-ae73-02136a0a812d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-459944732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea52077a8ebd4f33ad9bc320ac3280fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89810225-da", "ovs_interfaceid": "89810225-da25-4bac-92b2-9dc7f2d18f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG os_vif [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89810225-da, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad19fc3a-b7b7-47ea-9669-afd17aaab21c) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:24:31 user nova-compute[75703]: INFO os_vif [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:df:e8,bridge_name='br-int',has_traffic_filtering=True,id=89810225-da25-4bac-92b2-9dc7f2d18f30,network=Network(9252a479-cecb-4bd0-ae73-02136a0a812d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89810225-da')
Nov 10 15:24:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Deleting instance files /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08_del
Nov 10 15:24:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Deletion of /opt/stack/data/nova/instances/7ba759d6-fa79-49af-a3c2-342957048d08_del complete
Nov 10 15:24:31 user nova-compute[75703]: INFO nova.compute.manager [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 15:24:31 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:24:31 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Took 0.58 seconds to deallocate network for instance.
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-57661867-05ab-4f12-b6d0-a2f54c8b7fee req-cf20d23a-d534-489f-8945-4ad5d8991847 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-vif-deleted-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:24:31 user nova-compute[75703]: INFO nova.compute.manager [req-57661867-05ab-4f12-b6d0-a2f54c8b7fee req-cf20d23a-d534-489f-8945-4ad5d8991847 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Neutron deleted interface 89810225-da25-4bac-92b2-9dc7f2d18f30; detaching it from the instance and deleting it from the info cache
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.network.neutron [req-57661867-05ab-4f12-b6d0-a2f54c8b7fee req-cf20d23a-d534-489f-8945-4ad5d8991847 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:24:31 user nova-compute[75703]: DEBUG nova.compute.manager [req-57661867-05ab-4f12-b6d0-a2f54c8b7fee req-cf20d23a-d534-489f-8945-4ad5d8991847 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Detach interface failed, port_id=89810225-da25-4bac-92b2-9dc7f2d18f30, reason: Instance 7ba759d6-fa79-49af-a3c2-342957048d08 could not be found. {{(pid=75703) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Skipping network cache update for instance because it is being deleted. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:32 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Deleted allocations for instance 7ba759d6-fa79-49af-a3c2-342957048d08
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-8249480e-d33e-4d41-a0ee-e77d3c8c91c9 tempest-AttachVolumeNegativeTest-1477766545 tempest-AttachVolumeNegativeTest-1477766545-project-member] Lock "7ba759d6-fa79-49af-a3c2-342957048d08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.762s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-db7c688a-49a1-4f37-b045-d7732465a17a req-48df4580-9cfc-4c72-beb7-6136e3aa36d1 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received event network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-db7c688a-49a1-4f37-b045-d7732465a17a req-48df4580-9cfc-4c72-beb7-6136e3aa36d1 service nova] Acquiring lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-db7c688a-49a1-4f37-b045-d7732465a17a req-48df4580-9cfc-4c72-beb7-6136e3aa36d1 service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-db7c688a-49a1-4f37-b045-d7732465a17a req-48df4580-9cfc-4c72-beb7-6136e3aa36d1 service nova] Lock "7ba759d6-fa79-49af-a3c2-342957048d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:24:32 user nova-compute[75703]: DEBUG nova.compute.manager [req-db7c688a-49a1-4f37-b045-d7732465a17a req-48df4580-9cfc-4c72-beb7-6136e3aa36d1 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] No waiting events found dispatching network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:24:32 user nova-compute[75703]: WARNING nova.compute.manager [req-db7c688a-49a1-4f37-b045-d7732465a17a req-48df4580-9cfc-4c72-beb7-6136e3aa36d1 service nova] [instance: 7ba759d6-fa79-49af-a3c2-342957048d08] Received unexpected event network-vif-plugged-89810225-da25-4bac-92b2-9dc7f2d18f30 for instance with vm_state deleted and task_state None.
Nov 10 15:24:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:36 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:36 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:24:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:24:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:24:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:24:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:24:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:24:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:24:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:25:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:25:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:25:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:25:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:25:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:25:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:21 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:21 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:25:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:25:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:25:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:25:27 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:25:28 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:25:28 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:25:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=24.970508575439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:25:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:25:30 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:25:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:25:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:25:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:39 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:25:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:25:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:25:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:25:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:25:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:56 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:25:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:01 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:06 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:11 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:16 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:21 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:22 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:22 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:26:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:26:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:26:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=24.968433380126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:26:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:31 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:26:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:26:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:26:36 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:39 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:41 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:26:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:46 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:26:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:26:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:26:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:26:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:26:51 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:26:53 user nova-compute[75703]: INFO nova.compute.claims [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Claim successful on node user
Nov 10 15:26:53 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:26:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.policy [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eecf95afbc04e3292406f1ee922c62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a883d3188b834976b36de1043a88b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:26:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Creating image(s)
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "/opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "/opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "/opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.176s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk 1073741824" returned: 0 in 0.070s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.network.neutron [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Successfully created port: 182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:26:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Cannot resize image /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Ensure instance console log exists: /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Successfully updated port: 182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquired lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-changed-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Refreshing instance network info cache due to event network-changed-182c5716-2d1d-4d9d-880f-2268952a5aaf. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] Acquiring lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Releasing lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Instance network_info: |[{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] Acquired lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Refreshing network info cache for port 182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Start _get_guest_xml network_info=[{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:26:55 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:26:55 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1891567118',display_name='tempest-VolumesSnapshotTestJSON-instance-1891567118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1891567118',id=51,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoeMce/NwpFtDElBAoe67ej4ruUlHVRFA2NVA65Ve12g1Mc4rWL9inqww4KXZwi6CJaFycq6YUHLujtCmeq2JRZUkPMDPXMCDp6kxBoH2PhiaPEPwkRy56OgLkV/hiaug==',key_name='tempest-keypair-2094761525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a883d3188b834976b36de1043a88b56e',ramdisk_id='',reservation_id='r-7mcbh9nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1783404795',owner_user_name='tempest-VolumesSnapshotTestJSON-1783404795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eecf95afbc04e3292406f1ee922c62a',uuid=26b582bc-8188-4521-95f4-6d73182ef47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converting VIF {"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.objects.instance [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:26:55 user nova-compute[75703]:   <uuid>26b582bc-8188-4521-95f4-6d73182ef47d</uuid>
Nov 10 15:26:55 user nova-compute[75703]:   <name>instance-00000033</name>
Nov 10 15:26:55 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:26:55 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:26:55 user nova-compute[75703]:   <metadata>
Nov 10 15:26:55 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:26:55 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:26:55 user nova-compute[75703]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1891567118</nova:name>
Nov 10 15:26:55 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:26:55</nova:creationTime>
Nov 10 15:26:55 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:26:55 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:26:55 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:26:55 user nova-compute[75703]:       <nova:owner>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:user uuid="8eecf95afbc04e3292406f1ee922c62a">tempest-VolumesSnapshotTestJSON-1783404795-project-member</nova:user>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:project uuid="a883d3188b834976b36de1043a88b56e">tempest-VolumesSnapshotTestJSON-1783404795</nova:project>
Nov 10 15:26:55 user nova-compute[75703]:       </nova:owner>
Nov 10 15:26:55 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:26:55 user nova-compute[75703]:       <nova:ports>
Nov 10 15:26:55 user nova-compute[75703]:         <nova:port uuid="182c5716-2d1d-4d9d-880f-2268952a5aaf">
Nov 10 15:26:55 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 15:26:55 user nova-compute[75703]:         </nova:port>
Nov 10 15:26:55 user nova-compute[75703]:       </nova:ports>
Nov 10 15:26:55 user nova-compute[75703]:     </nova:instance>
Nov 10 15:26:55 user nova-compute[75703]:   </metadata>
Nov 10 15:26:55 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:26:55 user nova-compute[75703]:     <system>
Nov 10 15:26:55 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:26:55 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:26:55 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:26:55 user nova-compute[75703]:       <entry name="serial">26b582bc-8188-4521-95f4-6d73182ef47d</entry>
Nov 10 15:26:55 user nova-compute[75703]:       <entry name="uuid">26b582bc-8188-4521-95f4-6d73182ef47d</entry>
Nov 10 15:26:55 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:26:55 user nova-compute[75703]:     </system>
Nov 10 15:26:55 user nova-compute[75703]:   </sysinfo>
Nov 10 15:26:55 user nova-compute[75703]:   <os>
Nov 10 15:26:55 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:26:55 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:26:55 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:26:55 user nova-compute[75703]:   </os>
Nov 10 15:26:55 user nova-compute[75703]:   <features>
Nov 10 15:26:55 user nova-compute[75703]:     <acpi/>
Nov 10 15:26:55 user nova-compute[75703]:     <apic/>
Nov 10 15:26:55 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:26:55 user nova-compute[75703]:   </features>
Nov 10 15:26:55 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:26:55 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:26:55 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:26:55 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:26:55 user nova-compute[75703]:   </clock>
Nov 10 15:26:55 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:26:55 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:26:55 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:26:55 user nova-compute[75703]:   </cpu>
Nov 10 15:26:55 user nova-compute[75703]:   <devices>
Nov 10 15:26:55 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:26:55 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:26:55 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk"/>
Nov 10 15:26:55 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:26:55 user nova-compute[75703]:     </disk>
Nov 10 15:26:55 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:26:55 user nova-compute[75703]:       <mac address="fa:16:3e:05:ef:8b"/>
Nov 10 15:26:55 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:26:55 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:26:55 user nova-compute[75703]:       <target dev="tap182c5716-2d"/>
Nov 10 15:26:55 user nova-compute[75703]:     </interface>
Nov 10 15:26:55 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:26:55 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/console.log" append="off"/>
Nov 10 15:26:55 user nova-compute[75703]:     </serial>
Nov 10 15:26:55 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:26:55 user nova-compute[75703]:     <video>
Nov 10 15:26:55 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:26:55 user nova-compute[75703]:     </video>
Nov 10 15:26:55 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:26:55 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:26:55 user nova-compute[75703]:     </rng>
Nov 10 15:26:55 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:26:55 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:26:55 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:26:55 user nova-compute[75703]:     </memballoon>
Nov 10 15:26:55 user nova-compute[75703]:   </devices>
Nov 10 15:26:55 user nova-compute[75703]: </domain>
Nov 10 15:26:55 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1891567118',display_name='tempest-VolumesSnapshotTestJSON-instance-1891567118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1891567118',id=51,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoeMce/NwpFtDElBAoe67ej4ruUlHVRFA2NVA65Ve12g1Mc4rWL9inqww4KXZwi6CJaFycq6YUHLujtCmeq2JRZUkPMDPXMCDp6kxBoH2PhiaPEPwkRy56OgLkV/hiaug==',key_name='tempest-keypair-2094761525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a883d3188b834976b36de1043a88b56e',ramdisk_id='',reservation_id='r-7mcbh9nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1783404795',owner_user_name='tempest-VolumesSnapshotTestJSON-1783404795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eecf95afbc04e3292406f1ee922c62a',uuid=26b582bc-8188-4521-95f4-6d73182ef47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converting VIF {"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG os_vif [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8ab40ec-bd26-5347-8d5e-5595c5162a95', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap182c5716-2d, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap182c5716-2d, col_values=(('qos', UUID('ee793001-147c-4fa5-824d-e73e810fffbf')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap182c5716-2d, col_values=(('external_ids', {'iface-id': '182c5716-2d1d-4d9d-880f-2268952a5aaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:ef:8b', 'vm-uuid': '26b582bc-8188-4521-95f4-6d73182ef47d'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:55 user nova-compute[75703]: INFO os_vif [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d')
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No VIF found with MAC fa:16:3e:05:ef:8b, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updated VIF entry in instance network info cache for port 182c5716-2d1d-4d9d-880f-2268952a5aaf. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG nova.network.neutron [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:26:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a92ba3b2-210f-4b7f-ab7b-dfa04e73824c req-3ec24a27-1ed1-42d1-bfa8-78cb026bf5fa service nova] Releasing lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-d584b29e-ba19-4e3c-8524-583dfddef895 req-bfd8eb10-0532-4147-b654-024f50a2eee3 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d584b29e-ba19-4e3c-8524-583dfddef895 req-bfd8eb10-0532-4147-b654-024f50a2eee3 service nova] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d584b29e-ba19-4e3c-8524-583dfddef895 req-bfd8eb10-0532-4147-b654-024f50a2eee3 service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-d584b29e-ba19-4e3c-8524-583dfddef895 req-bfd8eb10-0532-4147-b654-024f50a2eee3 service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG nova.compute.manager [req-d584b29e-ba19-4e3c-8524-583dfddef895 req-bfd8eb10-0532-4147-b654-024f50a2eee3 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] No waiting events found dispatching network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:26:57 user nova-compute[75703]: WARNING nova.compute.manager [req-d584b29e-ba19-4e3c-8524-583dfddef895 req-bfd8eb10-0532-4147-b654-024f50a2eee3 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received unexpected event network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf for instance with vm_state building and task_state spawning.
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:57 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:26:59 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Instance spawned successfully.
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:26:59 user nova-compute[75703]: INFO nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-865cd009-c10f-4d3a-831f-35091daff826 req-b9eacca8-d03a-4494-a4ef-56bb3df8add0 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-865cd009-c10f-4d3a-831f-35091daff826 req-b9eacca8-d03a-4494-a4ef-56bb3df8add0 service nova] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-865cd009-c10f-4d3a-831f-35091daff826 req-b9eacca8-d03a-4494-a4ef-56bb3df8add0 service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-865cd009-c10f-4d3a-831f-35091daff826 req-b9eacca8-d03a-4494-a4ef-56bb3df8add0 service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:26:59 user nova-compute[75703]: DEBUG nova.compute.manager [req-865cd009-c10f-4d3a-831f-35091daff826 req-b9eacca8-d03a-4494-a4ef-56bb3df8add0 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] No waiting events found dispatching network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:26:59 user nova-compute[75703]: WARNING nova.compute.manager [req-865cd009-c10f-4d3a-831f-35091daff826 req-b9eacca8-d03a-4494-a4ef-56bb3df8add0 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received unexpected event network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf for instance with vm_state building and task_state spawning.
Nov 10 15:26:59 user nova-compute[75703]: INFO nova.compute.manager [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Took 5.61 seconds to build instance.
Nov 10 15:26:59 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b9ec00c8-9095-4f36-aada-db3f50fd67b0 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.708s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:27:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:27:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:27:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:27:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:23 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:27:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:28 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:27:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:27:28 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:27:28 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:27:28 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:27:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:27:29 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=24.938488006591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 26b582bc-8188-4521-95f4-6d73182ef47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:27:29 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:27:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:34 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:27:36 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:27:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:27:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:27:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:27:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:27:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:27:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:27:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:27:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:27:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:27:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:27:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:27:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:28:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:28:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:28:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:23 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:23 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:28:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:30 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:28:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:28:31 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.937938690185547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 26b582bc-8188-4521-95f4-6d73182ef47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:28:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:28:34 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:28:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:28:36 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:28:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:28:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:28:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:28:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:28:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-changed-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG nova.compute.manager [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Refreshing instance network info cache due to event network-changed-182c5716-2d1d-4d9d-880f-2268952a5aaf. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] Acquiring lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] Acquired lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Refreshing network info cache for port 182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'flavor' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:28:44 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Ignoring supplied device name: /dev/vdb
Nov 10 15:28:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updated VIF entry in instance network info cache for port 182c5716-2d1d-4d9d-880f-2268952a5aaf. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG nova.network.neutron [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:28:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-a41566e6-2603-4b08-85ed-c330234e51d4 req-9badb90d-17b4-4cc8-9e99-52b4d20bb106 service nova] Releasing lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:28:45 user nova-compute[75703]: INFO nova.compute.manager [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Attaching volume 1fb246fa-5d53-4812-b06d-02e577b22d8d to /dev/vdb
Nov 10 15:28:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG os_brick.utils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade1518-e858-49ca-a29a-c20fcde38637]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe316f2-2341-43d2-96bd-c4f3dacf6718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244b878-c37e-4232-8598-abac520717d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d8557-c3ec-4244-84ea-dc8469e731ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:28:45 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:28:45 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b4f340-9eb0-4256-98c4-e94ba90ef6f7]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG os_brick.utils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:28:45 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating existing volume attachment record: 3e6337c2-e199-4cbe-b47f-b8e911603d91 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:28:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:28:50 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:28:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:28:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:04 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:29:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:29:04 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 5 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:29:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:29:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:29:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:29:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANrzSZVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:29:20 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:29:20 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:29:20 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7dd305-d7b3-4073-b0cc-f3c256834371]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:29:20 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6975b856-f2a7-435b-9575-8a81d6332a97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d] added
Nov 10 15:29:20 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0832ee3d-d646-4db2-a594-10c500a534ad]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7828147-b607-4b2b-8aa7-c120260569e6]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANrzSZVC {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANrzSZVC" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f0f267-f277-44f8-9214-af49b5f0a365]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANrzSZVC'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2acafa7-fa00-48ae-8b97-cb565b5674b1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8041706c-6b98-44dc-b24c-5dd19cb7daa7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:29:20 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:29:20 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:29:20 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:29:20 user nova-compute[75703]: 
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd9bc4c-19f7-45fd-9d73-9226c16fcf6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260]
Nov 10 15:29:20 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260] successful.
Nov 10 15:29:20 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b0adf-3e7e-4496-8752-640a7385b3f7]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1efdd3a-0f57-497a-a891-2d306c13d284]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d (non-flash)
Nov 10 15:29:20 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d (non-flash)
Nov 10 15:29:20 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c6a7f-f118-4a96-ae1b-fe434c9a057c]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANrzSZVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:29:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23837643431643139', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837643431643139', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'flavor' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:29:21 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:29:21 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:29:21 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:29:21 user nova-compute[75703]:   <serial>1fb246fa-5d53-4812-b06d-02e577b22d8d</serial>
Nov 10 15:29:21 user nova-compute[75703]: </disk>
Nov 10 15:29:21 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No VIF found with MAC fa:16:3e:05:ef:8b, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:29:21 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e15f46d8-8109-4d35-a616-61204da3e7ca tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.209s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:29:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:31 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:29:32 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:29:32 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.936866760253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 26b582bc-8188-4521-95f4-6d73182ef47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:29:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:29:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:36 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:29:36 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [{"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-26b582bc-8188-4521-95f4-6d73182ef47d" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:29:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:29:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:29:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:29:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:29:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:29:55 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:30:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:30:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:30:00 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:30:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:30:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:30:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:30:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:30:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:30:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:19 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_power_states {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:19 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Triggering sync for uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 15:30:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:19 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:25 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:25 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:30:25 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:30 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:31 user nova-compute[75703]: INFO nova.compute.manager [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Detaching volume 1fb246fa-5d53-4812-b06d-02e577b22d8d
Nov 10 15:30:31 user nova-compute[75703]: INFO nova.virt.block_device [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Attempting to driver detach volume 1fb246fa-5d53-4812-b06d-02e577b22d8d from mountpoint /dev/vdb
Nov 10 15:30:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Attempting to detach device vdb from instance 26b582bc-8188-4521-95f4-6d73182ef47d from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:30:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:30:31 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:30:31 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:30:31 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:30:31 user nova-compute[75703]:   <serial>1fb246fa-5d53-4812-b06d-02e577b22d8d</serial>
Nov 10 15:30:31 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:30:31 user nova-compute[75703]: </disk>
Nov 10 15:30:31 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:30:31 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully detached device vdb from instance 26b582bc-8188-4521-95f4-6d73182ef47d from the persistent domain config.
Nov 10 15:30:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26b582bc-8188-4521-95f4-6d73182ef47d from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:30:31 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:30:31 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:30:31 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:30:31 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:30:31 user nova-compute[75703]:   <serial>1fb246fa-5d53-4812-b06d-02e577b22d8d</serial>
Nov 10 15:30:31 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:30:31 user nova-compute[75703]: </disk>
Nov 10 15:30:31 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:30:31 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:32 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:30:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.935806274414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 26b582bc-8188-4521-95f4-6d73182ef47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:30:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:30:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:30:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Skipping network cache update for instance because it is being deleted. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 15:30:38 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:30:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:44 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:30:50 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:52 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26b582bc-8188-4521-95f4-6d73182ef47d is timed out.
Nov 10 15:30:52 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully detached device vdb from instance 26b582bc-8188-4521-95f4-6d73182ef47d from the live domain config.
Nov 10 15:30:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANrzSZVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:30:52 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ee794-d51f-4047-8821-015901ea4de7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:30:52 user nova-compute[75703]: No targets found.
Nov 10 15:30:52 user nova-compute[75703]: iSNS:
Nov 10 15:30:52 user nova-compute[75703]: No targets found.
Nov 10 15:30:52 user nova-compute[75703]: STATIC:
Nov 10 15:30:52 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d
Nov 10 15:30:52 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:30:52 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:30:52 user nova-compute[75703]: FIRMWARE:
Nov 10 15:30:52 user nova-compute[75703]: No targets found.
Nov 10 15:30:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:30:52 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:30:52 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415d90d-4c0c-4e37-8964-27fefeb3f692]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f910540e-d61d-4bd7-aa64-3fac9a19bd4f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d (non-flash)
Nov 10 15:30:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d (non-flash)
Nov 10 15:30:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb480fbcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c691c2a-3afe-4c80-97e7-d38cb88fd95c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e4b7e-f966-474f-b081-57fecfeeff01]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087725b-8eb7-4b8a-bb1b-f711fd90b72e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a71833-0915-4bcb-be30-b2d88d5e2fe6]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e13cd8f-ad9b-4594-9d8a-8bd3ce6bd01e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8e4897-6686-4607-be31-0a1f30b952a2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260]
Nov 10 15:30:52 user nova-compute[75703]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d, portal: 172.16.0.220,3260] successful.
Nov 10 15:30:52 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[02524f47-697e-48bf-8127-02ec673547d8]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== disconnect_volume: return (281ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:30:52 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG nova.objects.instance [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'flavor' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-c28c2bc9-33d7-4dea-826a-cc4a27fa79ba tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.005s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.853s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:53 user nova-compute[75703]: INFO nova.compute.manager [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Terminating instance
Nov 10 15:30:53 user nova-compute[75703]: DEBUG nova.compute.manager [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-ecca4c09-8724-4bc9-8ac2-349e4a18b555 req-e916a3da-9336-4351-bbe3-ebaed50b947b service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-vif-unplugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ecca4c09-8724-4bc9-8ac2-349e4a18b555 req-e916a3da-9336-4351-bbe3-ebaed50b947b service nova] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ecca4c09-8724-4bc9-8ac2-349e4a18b555 req-e916a3da-9336-4351-bbe3-ebaed50b947b service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-ecca4c09-8724-4bc9-8ac2-349e4a18b555 req-e916a3da-9336-4351-bbe3-ebaed50b947b service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-ecca4c09-8724-4bc9-8ac2-349e4a18b555 req-e916a3da-9336-4351-bbe3-ebaed50b947b service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] No waiting events found dispatching network-vif-unplugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:30:53 user nova-compute[75703]: DEBUG nova.compute.manager [req-ecca4c09-8724-4bc9-8ac2-349e4a18b555 req-e916a3da-9336-4351-bbe3-ebaed50b947b service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-vif-unplugged-182c5716-2d1d-4d9d-880f-2268952a5aaf for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Instance destroyed successfully.
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.objects.instance [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'resources' on Instance uuid 26b582bc-8188-4521-95f4-6d73182ef47d {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1891567118',display_name='tempest-VolumesSnapshotTestJSON-instance-1891567118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1891567118',id=51,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoeMce/NwpFtDElBAoe67ej4ruUlHVRFA2NVA65Ve12g1Mc4rWL9inqww4KXZwi6CJaFycq6YUHLujtCmeq2JRZUkPMDPXMCDp6kxBoH2PhiaPEPwkRy56OgLkV/hiaug==',key_name='tempest-keypair-2094761525',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a883d3188b834976b36de1043a88b56e',ramdisk_id='',reservation_id='r-7mcbh9nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1783404795',owner_user_name='tempest-VolumesSnapshotTestJSON-1783404795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eecf95afbc04e3292406f1ee922c62a',uuid=26b582bc-8188-4521-95f4-6d73182ef47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converting VIF {"id": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "address": "fa:16:3e:05:ef:8b", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182c5716-2d", "ovs_interfaceid": "182c5716-2d1d-4d9d-880f-2268952a5aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_vif [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap182c5716-2d, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee793001-147c-4fa5-824d-e73e810fffbf) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:30:54 user nova-compute[75703]: INFO os_vif [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=182c5716-2d1d-4d9d-880f-2268952a5aaf,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182c5716-2d')
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:1fb246fa-5d53-4812-b06d-02e577b22d8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANrzSZVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:30:54 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f249a2e3-d26d-4941-89da-93be14d9ed2e]: Unexpected error while running command.
Nov 10 15:30:54 user nova-compute[75703]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:30:54 user nova-compute[75703]: Exit code: 21
Nov 10 15:30:54 user nova-compute[75703]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:30:54 user nova-compute[75703]: Stderr: '' {{(pid=87268) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 10 15:30:54 user nova-compute[75703]: Traceback (most recent call last):
Nov 10 15:30:54 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 10 15:30:54 user nova-compute[75703]:     ret = func(*f_args, **f_kwargs)
Nov 10 15:30:54 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 10 15:30:54 user nova-compute[75703]:     return func(*args, **kwargs)
Nov 10 15:30:54 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 10 15:30:54 user nova-compute[75703]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 10 15:30:54 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 10 15:30:54 user nova-compute[75703]:     return putils.execute(on_execute=on_execute,
Nov 10 15:30:54 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 10 15:30:54 user nova-compute[75703]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 10 15:30:54 user nova-compute[75703]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 15:30:54 user nova-compute[75703]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:30:54 user nova-compute[75703]: Exit code: 21
Nov 10 15:30:54 user nova-compute[75703]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:30:54 user nova-compute[75703]: Stderr: ''
Nov 10 15:30:54 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f249a2e3-d26d-4941-89da-93be14d9ed2e]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 15:30:54 user nova-compute[75703]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:30:54 user nova-compute[75703]: Exit code: 21
Nov 10 15:30:54 user nova-compute[75703]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:30:54 user nova-compute[75703]: Stderr: ''
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 10 15:30:54 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi 
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75703) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== disconnect_volume: return (32ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:30:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Deleting instance files /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d_del
Nov 10 15:30:54 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Deletion of /opt/stack/data/nova/instances/26b582bc-8188-4521-95f4-6d73182ef47d_del complete
Nov 10 15:30:54 user nova-compute[75703]: INFO nova.compute.manager [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 15:30:54 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:30:54 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:30:55 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:30:55 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Took 0.70 seconds to deallocate network for instance.
Nov 10 15:30:55 user nova-compute[75703]: DEBUG nova.compute.manager [req-28aaa8ab-d1d1-4482-b682-212383574441 req-7f31a417-ac92-4666-9876-022b4248af5d service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-vif-deleted-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:30:55 user nova-compute[75703]: WARNING nova.volume.cinder [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Attachment 3e6337c2-e199-4cbe-b47f-b8e911603d91 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3e6337c2-e199-4cbe-b47f-b8e911603d91. (HTTP 404) (Request-ID: req-b69b59af-b6c0-42f7-9788-8e5a3855244b)
Nov 10 15:30:55 user nova-compute[75703]: INFO nova.compute.manager [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 15:30:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:55 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:30:55 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:30:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:55 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Deleted allocations for instance 26b582bc-8188-4521-95f4-6d73182ef47d
Nov 10 15:30:55 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-54eacd44-cae5-4245-b339-c5e4ebd8b863 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "26b582bc-8188-4521-95f4-6d73182ef47d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-de16abc8-9df0-4a92-816f-92a6adcdc255 req-75ae2907-e1a1-4145-9b6b-69dc8bd2d54f service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received event network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:30:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-de16abc8-9df0-4a92-816f-92a6adcdc255 req-75ae2907-e1a1-4145-9b6b-69dc8bd2d54f service nova] Acquiring lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:30:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-de16abc8-9df0-4a92-816f-92a6adcdc255 req-75ae2907-e1a1-4145-9b6b-69dc8bd2d54f service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:30:56 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-de16abc8-9df0-4a92-816f-92a6adcdc255 req-75ae2907-e1a1-4145-9b6b-69dc8bd2d54f service nova] Lock "26b582bc-8188-4521-95f4-6d73182ef47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:30:56 user nova-compute[75703]: DEBUG nova.compute.manager [req-de16abc8-9df0-4a92-816f-92a6adcdc255 req-75ae2907-e1a1-4145-9b6b-69dc8bd2d54f service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] No waiting events found dispatching network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:30:56 user nova-compute[75703]: WARNING nova.compute.manager [req-de16abc8-9df0-4a92-816f-92a6adcdc255 req-75ae2907-e1a1-4145-9b6b-69dc8bd2d54f service nova] [instance: 26b582bc-8188-4521-95f4-6d73182ef47d] Received unexpected event network-vif-plugged-182c5716-2d1d-4d9d-880f-2268952a5aaf for instance with vm_state deleted and task_state None.
Nov 10 15:30:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:14 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:31:19 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:31:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:31:27 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:27 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:31:29 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:32 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:31:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:31:32 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:31:32 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:31:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:31:33 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:31:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9109MB free_disk=24.96292495727539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:31:33 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:31:34 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:39 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:39 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:31:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:31:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:31:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:44 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:31:45 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:31:49 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:54 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:31:59 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:04 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:09 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Starting instance... {{(pid=75703) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75703) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 15:32:11 user nova-compute[75703]: INFO nova.compute.claims [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Claim successful on node user
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Start building networks asynchronously for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Allocating IP information in the background. {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] allocate_for_instance() {{(pid=75703) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 15:32:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Start building block device mappings for instance. {{(pid=75703) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.policy [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eecf95afbc04e3292406f1ee922c62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a883d3188b834976b36de1043a88b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75703) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Start spawning the instance on the hypervisor. {{(pid=75703) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Creating instance directory {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 15:32:11 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Creating image(s)
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "/opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "/opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "/opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.181s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:11 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk 1073741824 {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef,backing_fmt=raw /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk 1073741824" returned: 0 in 0.052s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "7cd78f2579a426079c6207b8f548d7a38e8925ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Successfully created port: f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cd78f2579a426079c6207b8f548d7a38e8925ef --force-share --output=json" returned: 0 in 0.180s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk. size=1073741824 {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG nova.virt.disk.api [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Cannot resize image /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk to a smaller size. {{(pid=75703) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Created local disks {{(pid=75703) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Ensure instance console log exists: /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/console.log {{(pid=75703) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:12 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Successfully updated port: f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquired lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Building network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Instance cache missing network info. {{(pid=75703) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-changed-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.compute.manager [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Refreshing instance network info cache due to event network-changed-f9cd4e29-cd65-41fd-816f-fedf85bd6a64. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] Acquiring lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.neutron [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Releasing lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Instance network_info: |[{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75703) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] Acquired lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Refreshing network info cache for port f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Start _get_guest_xml network_info=[{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'image_id': '424c839a-ae27-4ecf-b640-8404a9fc9821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 15:32:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:32:13 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CPU controller missing on host. {{(pid=75703) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.host [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CPU controller found on host. {{(pid=75703) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75703) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T14:38:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T14:38:14Z,direct_url=<?>,disk_format='qcow2',id=424c839a-ae27-4ecf-b640-8404a9fc9821,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bfc7ba0b28e846f994e6c3d465e1047d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T14:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Flavor limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Image limits 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Flavor pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Image pref 0:0:0 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Got 1 possible topologies {{(pid=75703) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.hardware [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75703) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1239640626',display_name='tempest-VolumesSnapshotTestJSON-instance-1239640626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1239640626',id=52,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzWxvbwW4NggnwUGDq1OzfnAmr4sCcEAeiJCb8lONigOLrUUDHLR2SR5rc9FgaU9agVOiGHLI9ev5gQRVqrr53bQIuGm9ca6gnOdXmtcMZve3AKd9JcXFbXEw2D4W6p6Q==',key_name='tempest-keypair-1849284372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a883d3188b834976b36de1043a88b56e',ramdisk_id='',reservation_id='r-f49shk2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1783404795',owner_user_name='tempest-VolumesSnapshotTestJSON-1783404795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eecf95afbc04e3292406f1ee922c62a',uuid=70608fc7-0e8a-41c0-86c0-364e972787e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75703) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converting VIF {"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.objects.instance [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'pci_devices' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 15:32:13 user nova-compute[75703]:   <uuid>70608fc7-0e8a-41c0-86c0-364e972787e0</uuid>
Nov 10 15:32:13 user nova-compute[75703]:   <name>instance-00000034</name>
Nov 10 15:32:13 user nova-compute[75703]:   <memory>524288</memory>
Nov 10 15:32:13 user nova-compute[75703]:   <vcpu>1</vcpu>
Nov 10 15:32:13 user nova-compute[75703]:   <metadata>
Nov 10 15:32:13 user nova-compute[75703]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 15:32:13 user nova-compute[75703]:       <nova:package version="0.0.0"/>
Nov 10 15:32:13 user nova-compute[75703]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1239640626</nova:name>
Nov 10 15:32:13 user nova-compute[75703]:       <nova:creationTime>2023-11-10 15:32:13</nova:creationTime>
Nov 10 15:32:13 user nova-compute[75703]:       <nova:flavor name="m1.tiny">
Nov 10 15:32:13 user nova-compute[75703]:         <nova:memory>512</nova:memory>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:disk>1</nova:disk>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:swap>0</nova:swap>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:vcpus>1</nova:vcpus>
Nov 10 15:32:13 user nova-compute[75703]:       </nova:flavor>
Nov 10 15:32:13 user nova-compute[75703]:       <nova:owner>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:user uuid="8eecf95afbc04e3292406f1ee922c62a">tempest-VolumesSnapshotTestJSON-1783404795-project-member</nova:user>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:project uuid="a883d3188b834976b36de1043a88b56e">tempest-VolumesSnapshotTestJSON-1783404795</nova:project>
Nov 10 15:32:13 user nova-compute[75703]:       </nova:owner>
Nov 10 15:32:13 user nova-compute[75703]:       <nova:root type="image" uuid="424c839a-ae27-4ecf-b640-8404a9fc9821"/>
Nov 10 15:32:13 user nova-compute[75703]:       <nova:ports>
Nov 10 15:32:13 user nova-compute[75703]:         <nova:port uuid="f9cd4e29-cd65-41fd-816f-fedf85bd6a64">
Nov 10 15:32:13 user nova-compute[75703]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 15:32:13 user nova-compute[75703]:         </nova:port>
Nov 10 15:32:13 user nova-compute[75703]:       </nova:ports>
Nov 10 15:32:13 user nova-compute[75703]:     </nova:instance>
Nov 10 15:32:13 user nova-compute[75703]:   </metadata>
Nov 10 15:32:13 user nova-compute[75703]:   <sysinfo type="smbios">
Nov 10 15:32:13 user nova-compute[75703]:     <system>
Nov 10 15:32:13 user nova-compute[75703]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 15:32:13 user nova-compute[75703]:       <entry name="product">OpenStack Nova</entry>
Nov 10 15:32:13 user nova-compute[75703]:       <entry name="version">0.0.0</entry>
Nov 10 15:32:13 user nova-compute[75703]:       <entry name="serial">70608fc7-0e8a-41c0-86c0-364e972787e0</entry>
Nov 10 15:32:13 user nova-compute[75703]:       <entry name="uuid">70608fc7-0e8a-41c0-86c0-364e972787e0</entry>
Nov 10 15:32:13 user nova-compute[75703]:       <entry name="family">Virtual Machine</entry>
Nov 10 15:32:13 user nova-compute[75703]:     </system>
Nov 10 15:32:13 user nova-compute[75703]:   </sysinfo>
Nov 10 15:32:13 user nova-compute[75703]:   <os>
Nov 10 15:32:13 user nova-compute[75703]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 15:32:13 user nova-compute[75703]:     <boot dev="hd"/>
Nov 10 15:32:13 user nova-compute[75703]:     <smbios mode="sysinfo"/>
Nov 10 15:32:13 user nova-compute[75703]:   </os>
Nov 10 15:32:13 user nova-compute[75703]:   <features>
Nov 10 15:32:13 user nova-compute[75703]:     <acpi/>
Nov 10 15:32:13 user nova-compute[75703]:     <apic/>
Nov 10 15:32:13 user nova-compute[75703]:     <vmcoreinfo/>
Nov 10 15:32:13 user nova-compute[75703]:   </features>
Nov 10 15:32:13 user nova-compute[75703]:   <clock offset="utc">
Nov 10 15:32:13 user nova-compute[75703]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 15:32:13 user nova-compute[75703]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 15:32:13 user nova-compute[75703]:     <timer name="hpet" present="no"/>
Nov 10 15:32:13 user nova-compute[75703]:   </clock>
Nov 10 15:32:13 user nova-compute[75703]:   <cpu mode="custom" match="exact">
Nov 10 15:32:13 user nova-compute[75703]:     <model>Nehalem</model>
Nov 10 15:32:13 user nova-compute[75703]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 15:32:13 user nova-compute[75703]:   </cpu>
Nov 10 15:32:13 user nova-compute[75703]:   <devices>
Nov 10 15:32:13 user nova-compute[75703]:     <disk type="file" device="disk">
Nov 10 15:32:13 user nova-compute[75703]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 15:32:13 user nova-compute[75703]:       <source file="/opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk"/>
Nov 10 15:32:13 user nova-compute[75703]:       <target dev="vda" bus="virtio"/>
Nov 10 15:32:13 user nova-compute[75703]:     </disk>
Nov 10 15:32:13 user nova-compute[75703]:     <interface type="ethernet">
Nov 10 15:32:13 user nova-compute[75703]:       <mac address="fa:16:3e:14:1c:6a"/>
Nov 10 15:32:13 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:32:13 user nova-compute[75703]:       <mtu size="1442"/>
Nov 10 15:32:13 user nova-compute[75703]:       <target dev="tapf9cd4e29-cd"/>
Nov 10 15:32:13 user nova-compute[75703]:     </interface>
Nov 10 15:32:13 user nova-compute[75703]:     <serial type="pty">
Nov 10 15:32:13 user nova-compute[75703]:       <log file="/opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/console.log" append="off"/>
Nov 10 15:32:13 user nova-compute[75703]:     </serial>
Nov 10 15:32:13 user nova-compute[75703]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 15:32:13 user nova-compute[75703]:     <video>
Nov 10 15:32:13 user nova-compute[75703]:       <model type="virtio"/>
Nov 10 15:32:13 user nova-compute[75703]:     </video>
Nov 10 15:32:13 user nova-compute[75703]:     <rng model="virtio">
Nov 10 15:32:13 user nova-compute[75703]:       <backend model="random">/dev/urandom</backend>
Nov 10 15:32:13 user nova-compute[75703]:     </rng>
Nov 10 15:32:13 user nova-compute[75703]:     <controller type="usb" index="0" model="none"/>
Nov 10 15:32:13 user nova-compute[75703]:     <memballoon model="virtio">
Nov 10 15:32:13 user nova-compute[75703]:       <stats period="10"/>
Nov 10 15:32:13 user nova-compute[75703]:     </memballoon>
Nov 10 15:32:13 user nova-compute[75703]:   </devices>
Nov 10 15:32:13 user nova-compute[75703]: </domain>
Nov 10 15:32:13 user nova-compute[75703]:  {{(pid=75703) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1239640626',display_name='tempest-VolumesSnapshotTestJSON-instance-1239640626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1239640626',id=52,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzWxvbwW4NggnwUGDq1OzfnAmr4sCcEAeiJCb8lONigOLrUUDHLR2SR5rc9FgaU9agVOiGHLI9ev5gQRVqrr53bQIuGm9ca6gnOdXmtcMZve3AKd9JcXFbXEw2D4W6p6Q==',key_name='tempest-keypair-1849284372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a883d3188b834976b36de1043a88b56e',ramdisk_id='',reservation_id='r-f49shk2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1783404795',owner_user_name='tempest-VolumesSnapshotTestJSON-1783404795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T15:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eecf95afbc04e3292406f1ee922c62a',uuid=70608fc7-0e8a-41c0-86c0-364e972787e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converting VIF {"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG os_vif [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd') {{(pid=75703) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38802a13-d382-5747-b7d7-edfdc53101b8', '_type': 'linux-noop'}}, row=False) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9cd4e29-cd, may_exist=True, interface_attrs={}) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9cd4e29-cd, col_values=(('qos', UUID('7996143d-74c2-4712-b9f9-3b31de06e986')),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9cd4e29-cd, col_values=(('external_ids', {'iface-id': 'f9cd4e29-cd65-41fd-816f-fedf85bd6a64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:1c:6a', 'vm-uuid': '70608fc7-0e8a-41c0-86c0-364e972787e0'}),), if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:13 user nova-compute[75703]: INFO os_vif [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd')
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:32:13 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No VIF found with MAC fa:16:3e:14:1c:6a, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:32:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updated VIF entry in instance network info cache for port f9cd4e29-cd65-41fd-816f-fedf85bd6a64. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:32:14 user nova-compute[75703]: DEBUG nova.network.neutron [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:32:14 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b9f65e1c-a0f2-4bfd-a137-37bd3a332557 req-5689e3e4-712c-49ba-90b3-6281726e2fae service nova] Releasing lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-234ea7c0-8244-48cb-beb3-ffc35a488a12 req-fe2336bc-d528-4f13-97d5-731485447fc3 service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-234ea7c0-8244-48cb-beb3-ffc35a488a12 req-fe2336bc-d528-4f13-97d5-731485447fc3 service nova] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-234ea7c0-8244-48cb-beb3-ffc35a488a12 req-fe2336bc-d528-4f13-97d5-731485447fc3 service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-234ea7c0-8244-48cb-beb3-ffc35a488a12 req-fe2336bc-d528-4f13-97d5-731485447fc3 service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG nova.compute.manager [req-234ea7c0-8244-48cb-beb3-ffc35a488a12 req-fe2336bc-d528-4f13-97d5-731485447fc3 service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] No waiting events found dispatching network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:32:15 user nova-compute[75703]: WARNING nova.compute.manager [req-234ea7c0-8244-48cb-beb3-ffc35a488a12 req-fe2336bc-d528-4f13-97d5-731485447fc3 service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received unexpected event network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 for instance with vm_state building and task_state spawning.
Nov 10 15:32:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:15 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Instance event wait completed in 0 seconds for  {{(pid=75703) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Guest created on hypervisor {{(pid=75703) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 15:32:17 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Instance spawned successfully.
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Found default for hw_cdrom_bus of ide {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Found default for hw_disk_bus of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Found default for hw_input_bus of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Found default for hw_pointer_model of None {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Found default for hw_video_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Found default for hw_vif_model of virtio {{(pid=75703) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 15:32:17 user nova-compute[75703]: INFO nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Checking state {{(pid=75703) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 15:32:17 user nova-compute[75703]: INFO nova.compute.manager [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Took 6.01 seconds to build instance.
Nov 10 15:32:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-e9a987f7-2c05-4cff-9795-29d83973f286 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.116s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-74c9fc3e-c10c-4fdb-9428-e41ce96dc41e req-f3e7a33a-a9a0-43ae-81c5-923b1d868d94 service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74c9fc3e-c10c-4fdb-9428-e41ce96dc41e req-f3e7a33a-a9a0-43ae-81c5-923b1d868d94 service nova] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74c9fc3e-c10c-4fdb-9428-e41ce96dc41e req-f3e7a33a-a9a0-43ae-81c5-923b1d868d94 service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-74c9fc3e-c10c-4fdb-9428-e41ce96dc41e req-f3e7a33a-a9a0-43ae-81c5-923b1d868d94 service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:17 user nova-compute[75703]: DEBUG nova.compute.manager [req-74c9fc3e-c10c-4fdb-9428-e41ce96dc41e req-f3e7a33a-a9a0-43ae-81c5-923b1d868d94 service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] No waiting events found dispatching network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:32:17 user nova-compute[75703]: WARNING nova.compute.manager [req-74c9fc3e-c10c-4fdb-9428-e41ce96dc41e req-f3e7a33a-a9a0-43ae-81c5-923b1d868d94 service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received unexpected event network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 for instance with vm_state active and task_state None.
Nov 10 15:32:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:32:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:32:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:32:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:32:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:29 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:29 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:32:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:32:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:32:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:32:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:32:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:34 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:34 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:34 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:32:34 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:35 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:32:35 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.934406280517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 70608fc7-0e8a-41c0-86c0-364e972787e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:32:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:32:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:32:40 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:32:41 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:32:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:32:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:32:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:44 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:45 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:45 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:32:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:32:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:32:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:32:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:32:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:32:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:33:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:33:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:33:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:30 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:30 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:33:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:33:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:33:35 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:33:35 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:33:35 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:33:36 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:33:36 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=24.932151794433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 70608fc7-0e8a-41c0-86c0-364e972787e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:33:36 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:33:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:33:41 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:33:42 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:33:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:33:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:33:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:33:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:33:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:33:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:33:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:33:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:33:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:33:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:33:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:33:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-changed-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.compute.manager [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Refreshing instance network info cache due to event network-changed-f9cd4e29-cd65-41fd-816f-fedf85bd6a64. {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] Acquiring lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] Acquired lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Refreshing network info cache for port f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'flavor' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:34:02 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Ignoring supplied device name: /dev/vdb
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updated VIF entry in instance network info cache for port f9cd4e29-cd65-41fd-816f-fedf85bd6a64. {{(pid=75703) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.network.neutron [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-b4e5fa37-5f80-4c34-ae04-c034e86e99e0 req-c3b58baf-6e62-4d91-b5c8-2ac1ba970c0f service nova] Releasing lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:34:02 user nova-compute[75703]: INFO nova.compute.manager [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Attaching volume 70505faf-4ccd-4954-85e9-54e0474be54c to /dev/vdb
Nov 10 15:34:02 user nova-compute[75703]: DEBUG os_brick.utils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[096fac09-fb14-4a04-8b08-946eaee1a1e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c2abfbb986\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b89094-1ef6-4ac5-b445-528491cb04d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd78c2-4019-4b25-adf8-40cce1bed451]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e349f-08cd-4ef3-90c8-3d2290a98903]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Running cmd (subprocess): nvme version {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] 'nvme version' failed. Not Retrying. {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] nvme not present on system {{(pid=75703) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:34:02 user nova-compute[75703]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 15:34:02 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[336225a4-1643-4597-88aa-cadf7692bb8a]: (4, '') {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75703) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.lightos [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] LIGHTOS: no hostnqn found. {{(pid=75703) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG os_brick.utils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c2abfbb986', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:34:02 user nova-compute[75703]: DEBUG nova.virt.block_device [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating existing volume attachment record: 4ee8a2c9-3cdc-4cdb-bb8c-24b4f95d9fc8 {{(pid=75703) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 15:34:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:05 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:07 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:34:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:34:07 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 5 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:34:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:10 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:34:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:20 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Calling os-brick to attach iSCSI Volume {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjQMGpaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:34:25 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:34:25 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:34:25 user nova-compute[75703]: INFO os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98d506-b450-48ff-9185-8a38b6f06f58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 15:34:25 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --interface default --op new {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e326cfc-947b-45af-aa53-021a642a7bd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c] added\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c] added
Nov 10 15:34:25 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b93306-c26a-4014-9020-d851d7b6a182]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858f44a-3a5d-487f-8d50-8587e7c09124]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjQMGpaE {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjQMGpaE" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37079de-d05b-4a38-987a-b73d1d6d2724]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjQMGpaE'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31784ae-c33e-429b-8414-1088d35df94e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d81d76-17b7-4e92-b95a-0ce2bcc6d14e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:34:25 user nova-compute[75703]:  {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 15:34:25 user nova-compute[75703]:  {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:34:25 user nova-compute[75703]: WARNING os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 15:34:25 user nova-compute[75703]: 
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --login {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606cc6b-3867-4e3d-819e-d54e2b2f1bf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260]
Nov 10 15:34:25 user nova-compute[75703]: Login to [iface: default, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260] successful.
Nov 10 15:34:25 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a953b2-2e1f-495b-8cc7-7d99e754dec1]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6452f2b6-158b-47e1-b660-f2cf1f44f3ae]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c (non-flash)
Nov 10 15:34:25 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c (non-flash)
Nov 10 15:34:25 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Connected to 172.16.0.220:3260 {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75703) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75703) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaa6d16-5adc-4163-8400-460300d10290]: (4, ('- - 0', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:34:25 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75703) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjQMGpaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75703) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26136323830356635', 'path': '/dev/sdb'} {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136323830356635', 'path': '/dev/sdb'} {{(pid=75703) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG nova.objects.instance [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'flavor' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:34:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 15:34:26 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:34:26 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:34:26 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:34:26 user nova-compute[75703]:   <serial>70505faf-4ccd-4954-85e9-54e0474be54c</serial>
Nov 10 15:34:26 user nova-compute[75703]: </disk>
Nov 10 15:34:26 user nova-compute[75703]:  {{(pid=75703) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 15:34:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No BDM found with device name vda, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:34:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75703) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 15:34:27 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] No VIF found with MAC fa:16:3e:14:1c:6a, not building metadata {{(pid=75703) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 15:34:27 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-0c61c1a9-60cb-4ff5-89f5-6a76f6bc2aa5 tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.525s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:34:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:34:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:31 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:31 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:34:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:34:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:35 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75703) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 15:34:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:34:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=24.92333221435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 70608fc7-0e8a-41c0-86c0-364e972787e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:34:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:34:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:34:42 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquired lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Forcefully refreshing network info cache for instance {{(pid=75703) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG nova.objects.instance [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lazy-loading 'info_cache' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG nova.network.neutron [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [{"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Releasing lock "refresh_cache-70608fc7-0e8a-41c0-86c0-364e972787e0" {{(pid=75703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updated the network info_cache for instance {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:34:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:34:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:34:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:34:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:25 user nova-compute[75703]: INFO nova.compute.manager [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Detaching volume 70505faf-4ccd-4954-85e9-54e0474be54c
Nov 10 15:35:25 user nova-compute[75703]: INFO nova.virt.block_device [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Attempting to driver detach volume 70505faf-4ccd-4954-85e9-54e0474be54c from mountpoint /dev/vdb
Nov 10 15:35:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Attempting to detach device vdb from instance 70608fc7-0e8a-41c0-86c0-364e972787e0 from the persistent domain config. {{(pid=75703) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 15:35:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:35:25 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:35:25 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:35:25 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:35:25 user nova-compute[75703]:   <serial>70505faf-4ccd-4954-85e9-54e0474be54c</serial>
Nov 10 15:35:25 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:35:25 user nova-compute[75703]: </disk>
Nov 10 15:35:25 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:35:25 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully detached device vdb from instance 70608fc7-0e8a-41c0-86c0-364e972787e0 from the persistent domain config.
Nov 10 15:35:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70608fc7-0e8a-41c0-86c0-364e972787e0 from the live domain config. {{(pid=75703) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 15:35:25 user nova-compute[75703]: DEBUG nova.virt.libvirt.guest [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 15:35:25 user nova-compute[75703]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 15:35:25 user nova-compute[75703]:   <source dev="/dev/sdb"/>
Nov 10 15:35:25 user nova-compute[75703]:   <target dev="vdb" bus="virtio"/>
Nov 10 15:35:25 user nova-compute[75703]:   <serial>70505faf-4ccd-4954-85e9-54e0474be54c</serial>
Nov 10 15:35:25 user nova-compute[75703]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 15:35:25 user nova-compute[75703]: </disk>
Nov 10 15:35:25 user nova-compute[75703]:  {{(pid=75703) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 15:35:25 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:26 user nova-compute[75703]: DEBUG nova.virt.libvirt.driver [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 15:35:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:35:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:35:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:35:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:35:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:37 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:35:38 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=24.922348022460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Instance 70608fc7-0e8a-41c0-86c0-364e972787e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75703) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:35:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:35:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Skipping network cache update for instance because it is being deleted. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 15:35:43 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:35:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:45 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:46 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 70608fc7-0e8a-41c0-86c0-364e972787e0 is timed out.
Nov 10 15:35:46 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully detached device vdb from instance 70608fc7-0e8a-41c0-86c0-364e972787e0 from the live domain config.
Nov 10 15:35:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjQMGpaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:35:46 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a50aa-0305-4b06-a5f4-fb26f9ada248]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 15:35:46 user nova-compute[75703]: No targets found.
Nov 10 15:35:46 user nova-compute[75703]: iSNS:
Nov 10 15:35:46 user nova-compute[75703]: No targets found.
Nov 10 15:35:46 user nova-compute[75703]: STATIC:
Nov 10 15:35:46 user nova-compute[75703]: Target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c
Nov 10 15:35:46 user nova-compute[75703]:         Portal: 172.16.0.220:3260,-1
Nov 10 15:35:46 user nova-compute[75703]:                 Iface Name: default
Nov 10 15:35:46 user nova-compute[75703]: FIRMWARE:
Nov 10 15:35:46 user nova-compute[75703]: No targets found.
Nov 10 15:35:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 15:35:46 user nova-compute[75703]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 15:35:46 user nova-compute[75703]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75703) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c', 0)] {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc2c1ae-afc7-47cf-b4ec-186fd2f1b7de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[69126c46-2957-4ed4-bc63-4087c6d00a99]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c (non-flash)\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c (non-flash)
Nov 10 15:35:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c (non-flash)
Nov 10 15:35:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4c42a6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c'): ({'sdb'}, set())}) {{(pid=75703) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Removing single pathed devices sdb {{(pid=75703) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2265a93c-122f-433f-89a1-36f8455b1c81]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ad9555-7bf3-4c2e-b228-a25575b08d88]: (4, ('ok\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Flushing IO for device /dev/sdb {{(pid=75703) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec10c4-b015-4778-ba84-d65268dc5c7e]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75703) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ee7deb-55a3-4798-bb22-0a554bfd950b]: (4, ('1', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.linuxscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] SCSI volumes sdb have been removed. {{(pid=75703) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c')] {{(pid=75703) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa32a318-498b-4082-823d-2b2cd938c56f]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --logout {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --logout" returned: 0 in 0.038s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d1b495-02f5-4ee3-88be-104a480836ce]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260]
Nov 10 15:35:46 user nova-compute[75703]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c, portal: 172.16.0.220,3260] successful.
Nov 10 15:35:46 user nova-compute[75703]:  stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op delete {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4471a5-9fa2-4f21-ac32-fbdb1be7751b]: (4, ('', '')) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75703) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== disconnect_volume: return (256ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:35:46 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG nova.objects.instance [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'flavor' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-b4016c63-6e8f-4b91-a649-84db2994ec1b tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.554s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:47 user nova-compute[75703]: INFO nova.compute.manager [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Terminating instance
Nov 10 15:35:47 user nova-compute[75703]: DEBUG nova.compute.manager [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Start destroying the instance on the hypervisor. {{(pid=75703) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-0135800b-660e-4ede-a1a4-78cbe38d4884 req-58e9b122-42db-4f08-8efa-e26018778b1a service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-vif-unplugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0135800b-660e-4ede-a1a4-78cbe38d4884 req-58e9b122-42db-4f08-8efa-e26018778b1a service nova] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0135800b-660e-4ede-a1a4-78cbe38d4884 req-58e9b122-42db-4f08-8efa-e26018778b1a service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-0135800b-660e-4ede-a1a4-78cbe38d4884 req-58e9b122-42db-4f08-8efa-e26018778b1a service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-0135800b-660e-4ede-a1a4-78cbe38d4884 req-58e9b122-42db-4f08-8efa-e26018778b1a service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] No waiting events found dispatching network-vif-unplugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG nova.compute.manager [req-0135800b-660e-4ede-a1a4-78cbe38d4884 req-58e9b122-42db-4f08-8efa-e26018778b1a service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-vif-unplugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 for instance with task_state deleting. {{(pid=75703) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 15:35:47 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [-] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Instance destroyed successfully.
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.objects.instance [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lazy-loading 'resources' on Instance uuid 70608fc7-0e8a-41c0-86c0-364e972787e0 {{(pid=75703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.vif [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T15:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1239640626',display_name='tempest-VolumesSnapshotTestJSON-instance-1239640626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1239640626',id=52,image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzWxvbwW4NggnwUGDq1OzfnAmr4sCcEAeiJCb8lONigOLrUUDHLR2SR5rc9FgaU9agVOiGHLI9ev5gQRVqrr53bQIuGm9ca6gnOdXmtcMZve3AKd9JcXFbXEw2D4W6p6Q==',key_name='tempest-keypair-1849284372',keypairs=<?>,launch_index=0,launched_at=2023-11-10T15:32:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a883d3188b834976b36de1043a88b56e',ramdisk_id='',reservation_id='r-f49shk2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='424c839a-ae27-4ecf-b640-8404a9fc9821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1783404795',owner_user_name='tempest-VolumesSnapshotTestJSON-1783404795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T15:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eecf95afbc04e3292406f1ee922c62a',uuid=70608fc7-0e8a-41c0-86c0-364e972787e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converting VIF {"id": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "address": "fa:16:3e:14:1c:6a", "network": {"id": "09680e6b-3c13-439e-8cb4-19b5faeda050", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-759604270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a883d3188b834976b36de1043a88b56e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9cd4e29-cd", "ovs_interfaceid": "f9cd4e29-cd65-41fd-816f-fedf85bd6a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.network.os_vif_util [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd') {{(pid=75703) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_vif [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd') {{(pid=75703) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9cd4e29-cd, bridge=br-int, if_exists=True) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7996143d-74c2-4712-b9f9-3b31de06e986) {{(pid=75703) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:35:48 user nova-compute[75703]: INFO os_vif [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:1c:6a,bridge_name='br-int',has_traffic_filtering=True,id=f9cd4e29-cd65-41fd-816f-fedf85bd6a64,network=Network(09680e6b-3c13-439e-8cb4-19b5faeda050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9cd4e29-cd')
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] calling os-brick to detach iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4a4772560>, {'target_iqn': 'iqn.2010-10.org.openstack:70505faf-4ccd-4954-85e9-54e0474be54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjQMGpaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 15:35:48 user nova-compute[75703]: WARNING os_brick.initiator.connectors.base [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.020s {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2f1b260f-4183-47e8-ab9a-e4fe36994629]: Unexpected error while running command.
Nov 10 15:35:48 user nova-compute[75703]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:35:48 user nova-compute[75703]: Exit code: 21
Nov 10 15:35:48 user nova-compute[75703]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:35:48 user nova-compute[75703]: Stderr: '' {{(pid=87268) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 10 15:35:48 user nova-compute[75703]: Traceback (most recent call last):
Nov 10 15:35:48 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 10 15:35:48 user nova-compute[75703]:     ret = func(*f_args, **f_kwargs)
Nov 10 15:35:48 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 10 15:35:48 user nova-compute[75703]:     return func(*args, **kwargs)
Nov 10 15:35:48 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 10 15:35:48 user nova-compute[75703]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 10 15:35:48 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 10 15:35:48 user nova-compute[75703]:     return putils.execute(on_execute=on_execute,
Nov 10 15:35:48 user nova-compute[75703]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 10 15:35:48 user nova-compute[75703]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 10 15:35:48 user nova-compute[75703]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 15:35:48 user nova-compute[75703]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:35:48 user nova-compute[75703]: Exit code: 21
Nov 10 15:35:48 user nova-compute[75703]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:35:48 user nova-compute[75703]: Stderr: ''
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b260f-4183-47e8-ab9a-e4fe36994629]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87268) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 15:35:48 user nova-compute[75703]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:35:48 user nova-compute[75703]: Exit code: 21
Nov 10 15:35:48 user nova-compute[75703]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:35:48 user nova-compute[75703]: Stderr: ''
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 10 15:35:48 user nova-compute[75703]: ERROR os_brick.initiator.connectors.iscsi 
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75703) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.base [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG os_brick.initiator.connectors.iscsi [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] <== disconnect_volume: return (28ms) None {{(pid=75703) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Disconnected iSCSI Volume {{(pid=75703) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 15:35:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Deleting instance files /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0_del
Nov 10 15:35:48 user nova-compute[75703]: INFO nova.virt.libvirt.driver [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Deletion of /opt/stack/data/nova/instances/70608fc7-0e8a-41c0-86c0-364e972787e0_del complete
Nov 10 15:35:48 user nova-compute[75703]: INFO nova.compute.manager [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo.service.loopingcall [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75703) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.compute.manager [-] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Deallocating network for instance {{(pid=75703) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] deallocate_for_instance() {{(pid=75703) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 15:35:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG nova.network.neutron [-] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Updating instance_info_cache with network_info: [] {{(pid=75703) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 15:35:49 user nova-compute[75703]: INFO nova.compute.manager [-] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Took 0.74 seconds to deallocate network for instance.
Nov 10 15:35:49 user nova-compute[75703]: WARNING nova.volume.cinder [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Attachment 4ee8a2c9-3cdc-4cdb-bb8c-24b4f95d9fc8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4ee8a2c9-3cdc-4cdb-bb8c-24b4f95d9fc8. (HTTP 404) (Request-ID: req-416b7850-74f2-45a1-807a-32a32f80094f)
Nov 10 15:35:49 user nova-compute[75703]: INFO nova.compute.manager [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Took 0.02 seconds to detach 1 volumes for instance.
Nov 10 15:35:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-ee3bd394-4114-433b-afa7-b1a905ab3f84 req-6069340e-f037-45f4-8ea9-ade9fe34895c service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-vif-deleted-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:49 user nova-compute[75703]: INFO nova.scheduler.client.report [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Deleted allocations for instance 70608fc7-0e8a-41c0-86c0-364e972787e0
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-7635d4df-2708-4184-8dbc-8d08210ac18a tempest-VolumesSnapshotTestJSON-1783404795 tempest-VolumesSnapshotTestJSON-1783404795-project-member] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-6503d5b8-0e29-4e8b-873e-7adb597ea638 req-5105937d-9fbb-4ae2-a84b-2bcaf852549e service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received event network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6503d5b8-0e29-4e8b-873e-7adb597ea638 req-5105937d-9fbb-4ae2-a84b-2bcaf852549e service nova] Acquiring lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6503d5b8-0e29-4e8b-873e-7adb597ea638 req-5105937d-9fbb-4ae2-a84b-2bcaf852549e service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [req-6503d5b8-0e29-4e8b-873e-7adb597ea638 req-5105937d-9fbb-4ae2-a84b-2bcaf852549e service nova] Lock "70608fc7-0e8a-41c0-86c0-364e972787e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:35:49 user nova-compute[75703]: DEBUG nova.compute.manager [req-6503d5b8-0e29-4e8b-873e-7adb597ea638 req-5105937d-9fbb-4ae2-a84b-2bcaf852549e service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] No waiting events found dispatching network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 {{(pid=75703) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 15:35:49 user nova-compute[75703]: WARNING nova.compute.manager [req-6503d5b8-0e29-4e8b-873e-7adb597ea638 req-5105937d-9fbb-4ae2-a84b-2bcaf852549e service nova] [instance: 70608fc7-0e8a-41c0-86c0-364e972787e0] Received unexpected event network-vif-plugged-f9cd4e29-cd65-41fd-816f-fedf85bd6a64 for instance with vm_state deleted and task_state None.
Nov 10 15:35:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:35:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:35:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:36:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:36:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:36:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:36:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:36:38 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:36:38 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:36:39 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:36:39 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:36:39 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=24.94906234741211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:36:39 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:36:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:44 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:36:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:36:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:36:45 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:36:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:56 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:36:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:36:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:36:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:36:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:36:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:37:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:37:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:37:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:37:33 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:33 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:37:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:40 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:37:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:37:40 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:37:40 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:37:41 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:37:41 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:37:41 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9105MB free_disk=24.947826385498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:37:41 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:37:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:37:44 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:44 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:37:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:37:44 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:37:45 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:47 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:51 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:37:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:37:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:38:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:24 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:26 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:35 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:35 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:38:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:42 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:38:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:38:42 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:38:42 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:38:43 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:38:43 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:38:43 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=24.946147918701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:38:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:38:44 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:45 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:46 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:38:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:38:46 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:38:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:50 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:38:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:56 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:38:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:03 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:06 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:08 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:39:13 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:13 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:13 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances with incomplete migration  {{(pid=75703) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 15:39:16 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Cleaning up deleted instances {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 15:39:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] There are 1 instances to clean {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 15:39:16 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] [instance: d4465989-c669-4edd-b7d2-f71e203b7142] Instance has had 5 of 5 cleanup attempts {{(pid=75703) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 15:39:18 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:39:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:39:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:39:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75703) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 15:39:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:39:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75703) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 15:39:23 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:28 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:33 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:37 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:37 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75703) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 15:39:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:38 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:38 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager.update_available_resource {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:39:43 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Auditing locally available compute resources for user (node: user) {{(pid=75703) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 15:39:44 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:39:44 user nova-compute[75703]: WARNING nova.virt.libvirt.driver [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Hypervisor/Node resource view: name=user free_ram=9232MB free_disk=24.941425323486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75703) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75703) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing inventories for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating ProviderTree inventory for provider 0d48b957-effe-4e84-b4fe-1da545e413ee from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Updating inventory in ProviderTree for provider 0d48b957-effe-4e84-b4fe-1da545e413ee with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing aggregate associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, aggregates: None {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Refreshing trait associations for resource provider 0d48b957-effe-4e84-b4fe-1da545e413ee, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO {{(pid=75703) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.compute.provider_tree [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed in ProviderTree for provider: 0d48b957-effe-4e84-b4fe-1da545e413ee {{(pid=75703) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.scheduler.client.report [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Inventory has not changed for provider 0d48b957-effe-4e84-b4fe-1da545e413ee based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75703) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG nova.compute.resource_tracker [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Compute_service record updated for user:user {{(pid=75703) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 15:39:44 user nova-compute[75703]: DEBUG oslo_concurrency.lockutils [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75703) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 15:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:48 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 15:39:48 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Starting heal instance info cache {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 15:39:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Rebuilding the list of instances to heal {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 15:39:48 user nova-compute[75703]: DEBUG nova.compute.manager [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Didn't find any instances for network info cache update. {{(pid=75703) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 15:39:49 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:52 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:53 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 15:39:53 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:54 user nova-compute[75703]: DEBUG oslo_service.periodic_task [None req-1a009c2d-ed12-4eee-af26-d82bbceacaad None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 15:39:58 user nova-compute[75703]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75703) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}